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Converting Between Quadrilateral and Standard 
Solution Sets in Normal Surface Theory 

Benjamin A Burton 

The enumeration of normal surfaces is a crucial but very slow operation in algo- 
rithmic 3 -manifold topology. At the heart of this operation is a poly tope vertex 
enumeration in a high-dimensional space (standard coordinates). Tollefson's Q- 
theory speeds up this operation by using a much smaller space (quadrilateral 
coordinates), at the cost of a reduced solution set that might not always be suffi- 
cient for our needs. In this paper we present algorithms for converting between 
solution sets in quadrilateral and standard coordinates. As a consequence we ob- 
tain a new algorithm for enumerating all standard vertex normal surfaces, yielding 
both the speed of quadrilateral coordinates and the wider applicability of standard 
coordinates. Experimentation with the software package Regina shows this new 
algorithm to be extremely fast in practice, improving speed for large cases by 
factors from thousands up to millions. 
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1 Introduction 

The theory of normal surfaces plays a pivotal role in algorithmic 3 -manifold topology. 
Introduced by Kneser [17] and further developed by Haken [10, 11], normal sur- 
faces feature in key topological algorithms such as unknot recognition [10], 3-sphere 
recognition [20, 21, 22], connected sum and JSJ decomposition [16], and testing for 
incompressible surfaces [14]. 

The beauty of normal surface theory is that it allows difficult topological questions to 
be transformed into straightforward linear programming problems, yielding algorithms 
that are well-suited for computer implementation. Unfortunately these linear program- 
ming problems can be extremely expensive computationally, which is what motivates 
the work described here. 

Algorithms that employ normal surface theory typically operate as follows: 
(i) Begin with a compact 3 -manifold triangulation formed from n tetrahedra; 
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(ii) Enumerate all vertex normal surfaces within this triangulation, as described 
below; 

(iii) Search through this list for a surface of particular interest (such as an essential 
sphere for the connected sum decomposition algorithm, or an essential disc for 
the unknot recognition algorithm). 

The linear programming problem (and often the bottleneck for the entire algorithm) 
appears in step (ii). It can be shown that the set of all normal surfaces within a 
triangulation is described by a polytope in a 7«-dimensional vector space; step (ii) 
then requires us to enumerate the vertices of this polytope. The normal surfaces 
described by these vertices are called vertex normal surfaces. 

The trouble with step (ii) is that the vertex enumeration algorithm can grow expo- 
nentially slow in n; moreover, this growth is unavoidable since the number of vertex 
normal surfaces can likewise grow exponentially large. As a result, normal surface 
algorithms are (at the present time) unusable for large triangulations. 

Nevertheless, it is important to have these algorithms working as well as possible 
in practice. One significant advance in this regard was made by Tollefson [25], 
who showed that in certain cases, normal surface enumeration could be done in a 
much smaller vector space of dimension 3n. This 3n -dimensional space is called 
quadrilateral coordinates, and the resulting vertex normal surfaces (referred to by 
Tollefson as Q-vertex surfaces) form the quadrilateral solution set. For comparison, 
we refer to the original 7n-dimensional space as standard coordinates and its vertex 
normal surfaces as the standard solution set. It is important to note that these solution 
sets are different (in fact we prove in Lemma 4.5 that one is essentially a proper subset 
of the other). 

Practically speaking, quadrilateral coordinates are a significant improvement — although 
the running time remains exponential, experiments show that the enumeration of normal 
surfaces in quadrilateral coordinates runs orders of magnitude faster than in standard 
coordinates. 

However, using quadrilateral coordinates can be problematic from a theoretical point 
of view. In the algorithm overview given earlier, step (iii) requires us to prove that, if 
an interesting surface exists, then it exists as a vertex normal surface. Such results are 
more difficult to prove in quadrilateral coordinates, largely because addition becomes 
a more complicated operation; in particular, useful properties of surfaces that are linear 
functionals in standard coordinates (such as as Euler characteristic) are no longer 
linear in quadrilateral coordinates. As a result, only a few results appear in the 
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literature to show that quadrilateral coordinates can replace standard coordinates in 
certain topological algorithms. 

The purpose of this paper is, in essence, to show that we can have our cake and eat 
it too. That is, we show that we can enumerate vertex normal surfaces in standard 
coordinates (thereby avoiding the theoretical problems of quadrilateral coordinates) by 
first constructing the quadrilateral solution set and then converting this into the standard 
solution set (thus avoiding the performance problems of standard coordinates). The 
conversion process is not trivial (and indeed forms the bulk of this paper), but it is 
found to be extremely fast in practice. 

The key results in this paper are as follows: 

• Algorithm 4.6, which gives a simple procedure for converting the standard 
solution set into the quadrilateral solution set; 

• Algorithm 5.15, which gives a more complex procedure for converting the 
quadrilateral solution set into the standard solution set; 

• Algorithm 5.17, which builds on these results to provide a new way of enumerat- 
ing all vertex normal surfaces in standard coordinates, by going via quadrilateral 
coordinates as outlined above. 

The final algorithm in this list (Algorithm 5.17) is the "end product" of this paper — it 
can be dropped into any high-level topological algorithm that requires the enumeration 
of vertex normal surfaces. Experimentation shows that this new algorithm runs orders 
of magnitude faster than the current state-of-the-art, with consistent improvements of 
the order of 1 3 — 1 6 times the speed observed for large cases. Full details can be 
found in Section 6. 

The remainder of this paper is structured as follows. Section 2 introduces the theory of 
normal surfaces, and defines the standard and quadrilateral solution sets precisely. In 
Section 3 we address the ambiguity inherent in quadrilateral coordinates by studying 
canonical surfaces and vectors. Sections 4 and 5 contain the main results, where we 
describe the conversion from standard to quadrilateral coordinates and quadrilateral to 
standard coordinates respectively. We finish in Section 6 with experimental testing that 
shows how well these new algorithms perform in practice. 

Because this paper introduces a fair amount of notation, an appendix is included that 
lists the key symbols and where they are defined. 

For researchers who wish to perform their own experiments, the three algorithms listed 
above have been implemented in version 4.6 of the software package Regina [3, 4]. 
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2 Normal Surfaces 

In this section we provide the essential definitions of normal surface theory, includ- 
ing both Haken's original formulation (standard coordinates) and Tollefson's normal 
surface Q-theory (quadrilateral coordinates). 

We only present what is required to define the standard and quadrilateral solution sets. 
For a more thorough overview of normal surface theory the reader is referred to [12]; 
for further details on quadrilateral coordinates the reader is referred to Tollefson's 
original paper [25]. 

Definition 2.1 (Triangulation) A compact 3-manifold triangulation is a finite col- 
lection of tetrahedra Ai, . . . , A„, where some or all of the An tetrahedron faces are 
affmely identified in pairs, and where the resulting topological space is a compact 
3 -manifold. 

We allow different vertices of the same tetrahedron to be identified, and likewise with 
edges and faces (some authors refer to such structures as pseudo-triangulations or 
semi-simplicial triangulations). Any tetrahedron face that is not identified with some 
other tetrahedron face becomes part of the boundary of this 3 -manifold, and is referred 
to as a boundary face. 

Each equivalence class of tetrahedron vertices under these identifications is called a 
vertex of the triangulation; likewise with edges and faces. 

It should be noted that, according to this definition, the link of each vertex in the under- 
lying 3-manifold must be a disc or a 2-sphere. This rules out the ideal triangulations 
of Thurston [23] ; we discuss the reasons for this decision at the end of this section. 

Definition 2.2 (Normal Surface) Let T be a compact 3-manifold triangulation, and 
let A be a tetrahedron of T. A normal disc in A is a properly embedded disc in A 
which does not touch any vertices of A , and whose boundary consists of either (i) three 



Algebraic & Qeometric Topology XX (20XX) 



Converting Between Quadrilateral and Standard Solution Sets 



1005 



arcs running across three different faces of A , or (ii) four arcs running across all four 
faces of A . We refer to such discs as triangles and quadrilaterals respectively. 

There are seven different types of normal disc in a tetrahedron, defined by the choice 
of which tetrahedron edges a disc intersects. These include (i) four triangle types, each 
suiTounding a single vertex of A, and (ii) three quadrilateral types, each separating a 
single pair of opposite edges of A . All seven disc types are illustrated in Figure 1 . 




Figure 1 : The seven different types of normal disc in a tetrahedron 

An embedded normal surface in the triangulation T is a properly embedded surface 
that intersects each tetrahedron of T in a (possibly empty) collection of disjoint normal 
discs. Here we allow both disconnected surfaces and the empty surface. 

We consider two normal surfaces identical if they are related by a normal isotopy, i.e., 
an ambient isotopy that preserves each simplex of T. 

We divert briefly to define a particular class of normal surface that plays an important 
role in the relationship between standard and quadrilateral coordinates. 

Definition 2.3 (Vertex Link) Let T be a compact 3 -manifold triangulation, and let 
V be some vertex of T. We define the vertex link of V, denoted £(V), to be the normal 
surface that appears at the frontier of a small regular neighbourhood of V. In particular, 
£(V) contains one copy of each triangular disc type surrounding V, and contains no 
other normal discs at all. 

Here we follow the nomenclature of Jaco and Rubinstein [15]; in particular, Defini- 
tion 2.3 is not the same as the combinatorial link in a simplicial complex. Tollefson 
refers to vertex links as trivial surfaces [25]. 

Note that Definition 2.1 implies that £(V) is a disc or a 2-sphere (according to whether 
or not V is on the boundary of the 3-manifold). In the case where T is a one-vertex 
triangulation, the normal surface £(V) contains precisely one copy of every triangular 
disc type in the triangulation, and no other normal discs. 

At this point the theory of normal surfaces moves into linear algebra, whereupon we 
must choose between the formulation of Haken (standard coordinates) or Tollefson 
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(quadrilateral coordinates). In the text that follows we outline both formulations side 
by side. 

Definition 2.4 (Vector Representations) Let T be a compact 3 -manifold triangula- 
tion built from the n tetrahedra Ai , . . . , A n , and let S be an embedded normal surface 
in T. 

Consider the individual normal discs that form the surface S. Let tu denote the number 
of triangular discs of the y'th type in A,- (j = 1, 2, 3, 4), and let denote the number 
of quadrilateral discs of the kth type in A, (k = 1,2, 3). 

Then the standard vector representation of S, denoted \(S), is the In -dimensional 
vector 

V(5) = ( t\ t \, t\ t 2, fl,3, h,Ai 9i,i, 91,2, 9i,3 ; 

*2,1>*2,2>*2,3>*2,4> 92,1,92,2,92,3 \ 

, 9h,3 ), 

and the quadrilateral vector representation of S, denoted q(S), is the 3«-dimensional 
vector 

q(5) = (91,1,91,2)91,3 ; 92,1,92,2,92,3 ; •••,9n,3)- 

When we are working with standard vector representations in M 7 " we say we are 
working in standard coordinates. Likewise, when working with quadrilateral vector 
representations in M 3 " we say we are working in quadrilateral coordinates. 

It turns out that, if we ignore vertex links, then the vector representations contain 
enough information to completely reconstruct a normal surface. The results, due to 
Haken [10] and Tollefson [25], are as follows. 

Lemma 2.5 Consider two embedded normal surfaces S and T within some compact 
3 -manifold triangulation. 

• The standard vector representations of S and T are equal, that is, v(5) = \(T), 
if and only if surfaces S and T are identical. 

• The quadrilateral vector representations of S and T are equal, that is, q(S) = 
q(T), if and only if (i) S and T are identical, or (ii) S and T differ only by 
adding or removing vertex linking components. 
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Although every embedded normal surface has a standard and quadrilateral vector 
representation, there are many vectors in M 7 " and M 3 ' 1 respectively that do not represent 
any normal surface at all. Haken [10] and Tollefson [25] completely characterise which 
vectors represent embedded normal surfaces, using the concept of admissible vectors. 
We build up a definition of this concept now, and then present the full characterisation 
results of Haken and Tollefson in Theorem 2. 10. 

Definition 2.6 (Standard Matching Equations) Let T be a compact 3-manifold tri- 
angulation built from the n tetrahedra Ai , . . . , A„ , and consider some In -dimensional 
vector v = (ti,i,fi,2)*i,3)*i,4) 9i,i)9i,2)9i,3; • • • >9«,3) • For each non-boundary face F 
of T and each edge e of the face F, we obtain an equation as follows. 

In essence, our equation states that we must be able to match the normal discs on one 
side of F with the normal discs on the other. To express this formally, let A; and 
Ay be the two tetrahedra joined along face F. In each tetrahedron A,- and Ay there 
is precisely one triangle type and one quadrilateral type that meets face F in an arc 
parallel to e ; let these be described by the coordinates and q^ in A, and tj c and 
qj jC i in Aj . Our equation is then 

U,a + 9i,fe = f j,c + qj,d- 

The set of all such equations is called the set of standard matching equations for T. 



















A 







Figure 2: An example of the standard matching equations 

Note that if T has / non-boundary faces then there are 3/ such equations in total; in 
particular, if T has no boundary at all then there are 6ti standard matching equations. 
Figure 2 shows an illustration of one such equation; here we have one triangle and 
one quadrilateral in A,- meeting two triangles in Ay, giving (t^ a + q^b = 1 + 1) = 
(tj,c + qj,d = 2 + 0). 

Definition 2.7 (Quadrilateral Matching Equations) Let T be a compact 3-manifold 
triangulation built from the n tetrahedra Ai, . . . , A n , and consider some 3n -dimen- 
sional vector q = (qi^ , 9i,2 5 91,3; ■ • • j 9n,3) ■ For each non-boundary edge e of T, we 
obtain an equation as follows. 
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Consider the tetrahedra containing edge e ; these are arranged in a cycle around e as 
illustrated in Figure 3. Choose an arbitrary direction around this cycle, and arbitrarily 
label the two ends of e as upper and lower. 




Upward quadrilaterals Downward quadrilaterals 

Figure 3: Building the quadrilateral matching equations 

Within each of these tetrahedra, there are two quadrilateral types that meet edge e : the 
upward quadrilaterals, which rise from the lower end of e to the upper end as we move 
around the cycle, and the downward quadrilaterals, which fall in the opposite direction. 
These are again illustrated in Figure 3. 

We can now create an equation from edge e as follows. Let the tetrahedra containing 
e be A,-j , A,- 2 , . . . , A,- t , let the coordinates corresponding to the upward quadrilateral 
types be q^ iBj , qi 2lU2 , . . . , qi k , Uk , and let the coordinates corresponding to the downward 
quadrilateral types be qi u d x , <7i 2 ,d 2 > • • • i Qi k A ■ Then we obtain the equation 

+ a ii,u 2 + • • • + qi k ,u k = <lh,d\ + 9i2,<fc + • • • + QikAk- 

The set of all such equations is called the set of quadrilateral matching equations for 
T. 

We will see that both the standard and quadrilateral matching equations form necessary 
but not sufficient conditions for a non-negative integer vector to represent an embedded 
normal surface. We still need one more set of constraints, which we define as follows. 

Definition 2.8 (Quadrilateral Constraints) Let T be a compact 3 -manifold triangu- 
lation built from the n tetrahedra Ai, . . . , A„, and let w be either a 7«-dimensional 
vector of the form (t\ t i, £1,2, £1,3, *i,4, #1,1, #1,2, 91,3; ■ • • > 9n,3) > or a 3«-dimensional 
vector of the form (91,1 , 91,2, 91,3; • • • ,qn,l)- 

Then w satisfies the quadrilateral constraints if, for each tetrahedron A/ , at most of 
one of the quadrilateral coordinates qt \ , q^% and q^ is non-zero. 
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The quadrilateral constraints arise because any two quadrilaterals of different types 
within the same tetrahedron must intersect, yet embedded normal surfaces cannot 
have self-intersections. We have now gathered enough conditions for the complete 
characterisation results of Haken [10] and Tollefson [25], which we reproduce in 
Definition 2.9 and Theorem 2.10. 

Definition 2.9 (Admissible Vector) Let T be a compact 3 -manifold triangulation 
built from n tetrahedra. A (In or 3?i)-dimensional vector is called admissible if (i) its 
entries are all non-negative, (ii) it satisfies the (standard or quadrilateral) matching 
equations for T, and (iii) it satisfies the quadrilateral constraints for T . 

Theorem 2.10 Let T be a compact 3 -manifold triangulation built from n tetrahedra, 
and let w be a (In or 3n )-dimensional vector of integers. Then w is the (standard or 
quadrilateral) vector representation of an embedded normal surface in T if and only if 
w is admissible. 

Although we can now reduce normal surfaces to vectors in R 7n or R 3n , we still have 
infinitely many surfaces to search through if we are seeking an "interesting" surface, 
such as an essential 2-sphere or an incompressible surface. The following series of 
definitions, due to Jaco and Oertel [14], allow us to reduce such searches to finite 
problems by restricting our attention to what are known as vertex normal surfaces. 

Definition 2.11 (Projective Solution Space) For any dimension d, we define the 
following regions in E : 

• The non-negative orthant O d is the region in W 1 in which all coordinates are 
non-negative; that is, O d = {x £ R d \ x t > V/} . 

• The projective hyperplane J d is the hyperplane in W 1 where all coordinates sum 
to 1; that is, J d = {xeR d \ £ = 1}. 

Note that the intersection O d n J d is the unit simplex in M. d . 

Let T be a compact 3 -manifold triangulation built from n tetrahedra. The standard 
projective solution space for T, denoted y(T), is the region in IR 7 " consisting of 
all points in ln n J 7 " that satisfy the standard matching equations. Likewise, the 
quadrilateral projective solution space for T, denoted £i(T), is the region in M 3n 
consisting of all points in 3n n J 3n that satisfy the quadrilateral matching equations. 

Since each O d n J d is the unit simplex and the matching equations are both linear and 
rational, it follows that the standard and quadrilateral projective solution spaces are 
(finite) convex rational polytopes in M 7 " and M. respectively. 
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It is clear from Theorem 2. 10 that the non-zero vectors in IR or IR that represent 
embedded normal surfaces are precisely those positive multiples of points in J^(T) or 
J2(T) that (i) are integer vectors, and (ii) satisfy the quadrilateral constraints. 

Definition 2.12 (Projective Image) Suppose that x G M. d is not the zero vector. We 
define the projective image of x, denoted x, to be the vector x/ ^ Xj. In other words, 
x is the (unique) multiple of x that lies in the projective hyperplane J d . 

To avoid complications with vertex links and the empty surface, we define the projective 
image of the zero vector to be the zero vector. That is, = (which does not lie in 
the projective hyperplane J d ). 

Let S be an embedded normal surface in some triangulation T. To keep our notation 
clean, we write the projective images of the vector representations \(S) and q(S) as 
\(S) and q(S) respectively. 

Definition 2.13 (Vertex Normal Surface) Let T be a compact 3-manifold triangu- 
lation built from n tetrahedra, and let S be an embedded normal surface in T. We 
call S a standard vertex normal surface if and only if \(S) (the projective image of 
the standard vector representation of S) is a vertex of the polytope S^(T). Likewise, 
we call S a quadrilateral vertex normal surface if and only if q(5) is a vertex of the 
polytope =2(T). 

Although vertex normal surfaces correspond to vertices of the projective solution 
space, this correspondence does not always work in the other direction. Instead we 
must restrict our attention to vectors that satisfy the quadrilateral constraints. 

Definition 2.14 (Solution Sets) Let T be a compact 3-manifold triangulation built 
from n tetrahedra. The standard solution set for T is the (finite) set of all vertices of the 
polytope o5^(T) that satisfy the quadrilateral constraints. Likewise, the quadrilateral 
solution set for T is the (finite) set of all vertices of the polytope J2(T) that satisfy the 
quadrilateral constraints. 

The correspondence between solution sets and vertex normal surfaces is now an im- 
mediate consequence of Theorem 2. 10 and the fact that each projective solution space 
is a rational polytope: 

Corollary 2.15 Let T be a compact 3 -manifold triangulation built from n tetrahedra, 
and let w be a (In or 3n )-dimensional vector. Then w is the projective image of the 
vector representation for a (standard or quadrilateral) vertex normal surface if and only 
if w is in the (standard or quadrilateral) solution set. 
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We return now to the overview of a "typical normal surface algorithm" as given in 
Section 1. Such algorithms typically work because we can prove that, if a 3 -manifold 
triangulation contains an "interesting" surface, then it contains an interesting vertex 
normal surface. Examples of such theorems include: 

• Jaco and Oertel [14] show that, if a closed irreducible 3 -manifold triangulation 
contains a two-sided incompressible surface, then such a surface exists as a 
standard vertex normal surface. Jaco and Tollefson [16] extend this result to 
bounded manifolds, and Tollefson [25] shows that such a surface must also exist 
as a quadrilateral vertex normal surface. 

• Jaco and Tollefson [16] prove similar results for essential spheres in closed 3- 
manifolds and essential compression discs in bounded irreducible 3-manifolds; 
in particular, they show that if such a surface exists then one can be found amongst 
the standard vertex normal surfaces. With these results, they build algorithms to 
solve problems such as connected sum decomposition, JSJ decomposition and 
unknot recognition. 

We can therefore build such an algorithm by constructing the standard or quadrilateral 
solution set for our triangulation, and then searching through the solutions for one that 
scales to an "interesting" normal surface. 

The construction of the solution sets is, though finite, an exponentially slow procedure 
in the number of tetrahedra n . The best known algorithm to date is described in [5] ; it is 
essentially a variant of the double description method of Motzkin et al. [19], modified 
in several ways to exploit the quadrilateral constraints for greater speed and lower 
memory consumption. 

The remainder of this paper is concerned mainly with the conversion between the 
standard solution set and the quadrilateral solution set. Upon establishing conversion 
algorithms in both directions (Algorithms 4.6 and 5. 15), we finish with a new algorithm 
for constructing the standard solution set (Algorithm 5.17) that is orders of magnitude 
faster than the current state-of-the-art. 

We conclude this section with a brief discussion of ideal triangulations. These trian- 
gulations, due to Thurston [23], include vertices whose links are neither 2-spheres nor 
discs, but rather closed surfaces with genus (such as tori or Klein bottles). By removing 
these vertices (and only these vertices), we obtain a triangulation of a non-compact 
3-manifold. One of the most well-known ideal triangulations is the two-tetrahedron 
triangulation of the figure eight knot complement, discussed in detail in [18]. 

Quadrilateral coordinates play a special role in ideal triangulations — they allow us to 
describe spun normal surfaces, which contain infinitely many triangular discs spiralling 
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in towards the high-genus vertices. Such surfaces cannot be represented in standard 
coordinates at all, which is why we must restrict our attention in this paper to compact 
3-manifold triangulations. The reader is referred to Tillmann [24] for a thorough 
overview of spun normal surfaces. 

3 Canonical Surfaces and Vectors 

Although our eventual goal is to construct algorithms for converting between the 
standard and quadrilateral solution sets, we begin in this section with the more modest 
aim of converting between standard and quadrilateral vectors. 

One complication we face is that, whereas vectors in standard coordinates represent 
unique normal surfaces, vectors in quadrilateral coordinates do not (Lemma 2.5). We 
work around this uniqueness problem by introducing the notion of canonical surfaces 
and canonical vectors in standard coordinates. Although this allows us to map vectors 
in quadrilateral coordinates to unique canonical vectors in standard coordinates and 
unique canonical surfaces, we will find that these maps are not as well-behaved as we 
might like them to be. 

The structure of this section is as follows. We first define canonical surfaces and 
canonical vectors and examine some of their basic properties. Following this we study 
several additional maps between both surfaces and vectors; amongst these maps are the 
quadrilateral projection ir : M 1 " — > M? n and the canonical extension e : M 3 ' 1 — > M 7 " , 
which convert back and forth between vectors in standard and quadrilateral coordinates. 
We finish the section with Algorithm 3.12, which shows how these conversions can be 
performed in as fast a time complexity as possible. 

Throughout this section, we assume that we are working with a compact 3-manifold 
triangulation T built from n tetrahedra. We also allow a little flexibility with our 
notation: the expression £(V) will be used to refer to both the vertex linking surface 
surrounding V (as presented in Definition 2.3) and also its standard vector representa- 
tion in R ln . 

Definition 3.1 (Canonical Normal Surface) A canonical normal surface in the tri- 
angulation T is an embedded normal surface that does not contain any vertex linking 
components. 

The purpose of this definition is to resolve the ambiguities inherent in quadrilateral 
coordinates. In particular, it gives us the following uniqueness properties, which follow 
immediately from Lemma 2.5 and Theorem 2. 10: 
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Lemma 3.2 Let S and T be canonical normal surfaces within the triangulation T. 
Then the quadrilateral vector representations ofS and T are equal, that is, q(S) = q(T), 
if and only if surfaces S and T are identical. 

Lemma 3.3 Let w be a 3n -dimensional vector of integers. Then w is the quadrilateral 
vector representation of a canonical normal surface in T if and only if w is admissible. 
Moreover, this canonical normal surface is unique. 

Instead of thinking of canonical surfaces as having no vertex links, we can instead 
think of them as surfaces where it is impossible to remove a vertex link. With this in 
mind, we extend the concept from surfaces to vectors as follows. 

Definition 3.4 (Canonical Vector) Let w be any vector in M 7 " (i.e., in standard 
coordinates). We call w a canonical vector if and only if (i) all triangular coordinates 
of w are non-negative, but (ii) if we subtract e£(V) for any e > and any vertex link 
£(V) then some triangular coordinate of w must become negative. 

In other words, for each vertex V of the triangulation T, the following property must 
hold. Let tj [ j [ , ti 2 j 2 , . . . , t\ k j k be the coordinates in w corresponding to the triangular 
normal discs surrounding V. Then all of f, ls/1 , U 2 j 2 , . . . , ti k j k are at least zero, and at 
least one of these coordinates is equal to zero. 

Essentially this definition states that (i) w might be admissible (having non-negative 
triangular coordinates), but (ii) w — e£(V) can never be admissible. 

We have already established two bijections between surfaces and vectors: Theorem 2. 10 
shows a bijection between embedded normal surfaces and admissible integer vectors 
in M 1 ", and Lemma 3.3 shows a bijection between canonical normal surfaces and 
admissible integer vectors in M 3 ' 1 . We can now extend this list with a bijection between 
canonical normal surfaces and admissible canonical integer vectors in MJ n . 

Lemma 3.5 The standard vector representation of a canonical normal surface is a 
canonical vector in M 7 " . Conversely, every admissible canonical integer vector in MJ" 
is the standard vector representation of a (unique) canonical normal surface. 



Proof This result follows immediately from Theorem 2. 10 by observing that, if an 
admissible mteger vector w G M 7 " is not canonical, then all of the triangular coordinates 
surrounding some vertex V are > 1 , and so w = £(V) + w' for some other admissible 
integer vector w' . □ 
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We can observe that, if we restrict our attention to admissible integer vectors, then we 
have bijections between (i) canonical vectors in standard coordinates and canonical 
surfaces, and (ii) vectors in quadrilateral coordinates and canonical surfaces. It follows 
then that we must have a bijection between canonical vectors in standard coordinates 
and vectors in quadrilateral coordinates; that is, a method for converting between 
coordinate systems. We develop this idea further in Definition 3.10. 

Although the "canonical" property gives us uniqueness results and bijections that 
we did not have before, it is not particularly well-behaved. In particular, it is clear 
from Definition 3.4 that this property is preserved under scalar multiplication but not 
necessarily under addition. However, we can salvage the situation a little as seen in the 
following result. 

Lemma 3.6 If w € M 7 " is a canonical vector then so is Aw for any A > . Likewise, 
if w G M 7 " is an admissible canonical vector then so is Aw for any A > . Finally, if 
w = x + y for admissible vectors w, x, y £ IR 7 " and w is canonical then so are x and 

y- 

Proof This follows immediately from Definition 3.4 and the fact that the matching 
equations are invariant under scalar multiplication. □ 

We proceed now to define several mappings that express the relationships between 
canonical surfaces, non-canonical surfaces, vectors in standard coordinates and vectors 
in quadrilateral coordinates. Lemma 3.11 summarises the interplay between these 
relationships. We begin by presenting notation for the domains and ranges of these 
functions. 

Notation 3.7 Let § denote the set of all embedded normal surfaces (up to normal 
isotopy), and let § c C § denote the set of all canonical normal surfaces. Let R 7 " and 
M-l" denote the set of all admissible vectors in In and 3n dimensions respectively, and 
let M 7 " c C M 7 " denote the set of all admissible canonical vectors in In dimensions. 
Likewise, let Z 7 ' 1 and 1?" denote the set of all admissible integer vectors in In and 3n 
dimensions respectively, and let Z 7 " c C Z 7 " denote the set of all admissible canonical 
integer vectors in In dimensions. 

It follows then that standard vector representation is a bijection v : § — > Z 7,! that 
takes the subset S c C § to the subset Z 7 ". C Z 7 ". Likewise, quadrilateral vector 
representation is a many-to-one function q : § — > I? c " that becomes a bijection when 
restricted to S c . 
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Definition 3.8 (Represented Surface) Let w be an admissible integer vector in M . 
Then the represented surface of w , denoted cr v (w) , is the unique embedded normal 
surface with standard vector representation w (as noted in Theorem 2.10). Thus 
a v : Z 7,1 — > § is the inverse function to v : § — > Z 7 " . 

Likewise, let w be an admissible integer vector in M 3 " . Then the represented surface 
of w, denoted a q (vf), is the unique canonical normal surface with quadrilateral vector 
representation w (as noted in Lemma 3.3). Thus a q : Z 3 " — ► S c is the inverse function 
to the restriction q : S c — ► Z 3,! . 

Definition 3.9 (Canonical Part) Let S be an embedded normal surface within the 
triangulation T. The canonical part of 5, denoted k s (S), is the canonical normal 
surface obtained by removing all vertex linking components from S. It follows that k s 
is a function k s : § — > S c whose restriction to S c is the identity. 

Similarly, let w be any vector in M 7 ". The canonical part of w, denoted k v ,(w), is 
the unique canonical vector that can be obtained from w by adding and/or subtracting 
scalar multiples of vertex links. It follows that, if we restrict our attention to admissible 
vectors, then k v is a function k v : IR 7 " — ► R 7 " c whose restriction to MJ a " c is the identity. 

The canonical part of a vector w £ IR 7 ' 1 can be constructed as follows. Let the vertices 
of the triangulation be Vi , . . . , V m , and for each i let A, be the minimum of all triangular 
coordinates in w that correspond to triangular normal discs surrounding Vi (so w is 
canonical if and only if every A/ = 0). Then «; v (w) = w — Xi£(Vi) — ... — X m £(V m ). 

We now come to the point of defining conversion functions between vectors in standard 
coordinates and vectors in quadrilateral coordinates. 

Definition 3.10 (Projection and Extension) Let w S M 7 ' 1 be any vector in standard 
coordinates; recall that the In coordinates of w correspond to 3n quadrilateral disc 
types and 4n triangular disc types. The quadrilateral projection of w, denoted 7r(w), 
is denned to be the vector in M?" consisting of only the 3n quadrilateral coordinates 
for w. That is, if 

W = ( fl,l,fl,2,fl,3)fl,4j 9l,l:9l,2j9l,3 > 
h, l,h,Z ,h,3,h,4i <?2,l,<?2,2,^2,3 I 

,q n ,3 ) £ ~^ 7 ", 

then 

7r(w) = (91,1,91,2,91,3; 92,1,92,2,92,3; • • • ,9„,3 ) G K 3 "- 
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Conversely, let w £ be any admissible vector in quadrilateral coordinates. The 
canonical extension of w , denoted e(w) , is defined to be the unique admissible canon- 
ical vector in M. 7 a " c whose quadrilateral projection is w. 

It follows that, if we restrict our attention to admissible canonical vectors, then the 
quadrilateral projection tt : MJ a n c — ► K^" is the inverse function to the canonical exten- 
sion e: M? a n -> R 7 a n c . 

It does need to be shown that canonical extension is well-defined; that is, that for 
any admissible w 6 M.^" there is a unique admissible canonical x € MJ a " c for which 
7r(x) = w. Lemmata 3.3 and 3.5 together show this to be true in the integers; since 
admissibility and canonicity are invariant under positive scalar multiplication this is 
also true in the rationals, and because the matching equations are rational and linear 
this fact extends to the reals. 

Quadrilateral projection and canonical extension are true "conversion functions", in 
the sense that if S is any embedded normal surface then tt maps v(5) i— ► q(S) , and if 
S is also canonical then e maps q(5) i— > v(5) . The advantage of the broader definition 
above is that tt and e can also be applied to rational and real vectors, which means that 
we can use them to convert not just vector representations of surfaces but also arbitrary 
admissible points within the projective solution spaces. 

This brings us to the end of our list of mappings. To conclude this section, we bring 
these mappings together and show how they interact (Lemma 3.11), and then we 
describe how the conversions tt and e can be performed in as fast a time complexity 
as possible (Algorithm 3.12). 




Figure 4: A commutative diagram of mappings 



Lemma 3.11 Consider Figure 4, which shows the interactions between the maps v, 
q , <t v , o q , k s , k v , tt and e . Note that some of these maps appear twice — once in their 
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full generality, and once when restricted to canonical surfaces or vectors. All of the 
unnamed hooked arrows in this diagram are inclusion maps. Then the following facts 
are true: 

(i) Figure 4 is a commutative diagram. 

(ii) All double arrows in this diagram represent inverse functions. This includes the 
pair v, o~ v : § ^ Zj 1 , their canonical restrictions \,a v : S c ^ Z^", P ajr 
q, <jq : S c ^ I? a n , and the pair vr, e : Rj£. ^ Rj" . 

(Hi) Of the three vector-to-vector maps (it, e and k v ), only it is linear. 1 The 
remaining maps e and k v preserve scalar multiplication (that is, e(Aw) = Ae(w) 
and k v (Aw) = Are v (w) for X > 0), but they need not preserve addition. The 
non-linear maps e and k v are drawn in the diagram with dotted lines. 

Proof These observations are all straightforward consequences of the relevant defini- 
tions, and we do not recount the details here. The one additional observation required 
is that vertex linking surfaces only contain triangular discs, which is why q o k s = q 
and 7r o k v = 7T (since q and ir ignore triangular discs entirely). □ 

Note that some of the maps described by Lemma 3.11 are more general than Figure 4 
indicates. In particular, both ir and k v are defined on all 7«-dimensional vectors, 
admissible or not. The commutative relationship n o k v = it still holds in this more 
general setting, but we do not worry about this here. 

We return now to the two key conversion functions: the quadrilateral projection 
7r : MJ n — > M? n and the canonical extension e : R?" — > M. 7 a n c . It is clear how to 
compute 7r(w) quickly (just drop all triangular coordinates from w), but it is less clear 
how to compute e(w) quickly. 

A simple algorithm for computing g(w) might run as follows. Given a quadrilateral 
vector w G M^", we solve the standard matching equations using typical methods of 
linear algebra to obtain a matching set of triangular coordinates (there will be many 
solutions but any one will do), and then we apply k v to make the resulting vector in 
M. 7 " canonical. 

However, this algorithm is slow — to solve the standard matching equations requires 
0(n 3 ) time for a simple implementation, though more sophisticated solvers can improve 

'By "linear", we only require here that 7r(Ax + /ny) = \ir(x) + fiir(y) for A, /i > 0. This is 
because the domains M.J" and M. 7 a " c are not closed under multiplication by A < 0. 
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upon this a little. 2 It turns out that for the specific problem of computing e(w) we can 
do much better, as seen in the following result. 

Algorithm 3.12 Let w 6 be any admissible vector in quadrilateral coordinates. 
Then the following algorithm computes the canonical extension e(w), and does so in 
0(ri) time. 

We begin by constructing a vector 

x = ( h, i)fi,2)*i,3)fi,4) ?i,i)9i,2)9i,3 ; 

h,l, f 2,2, *2,3) f 2,4, 92,1)92,2,92,3 \ 

whose quadrilateral coordinates qij are copied directly from w, and whose triangular 
coordinates tn are initially unknown. Then, for each vertex V of the triangulation T, 
we perform the following steps: 

1 . Choose an arbitrary triangular disc type surrounding V, and set the corresponding 
triangular coordinate of x to zero. 

2. Run through all triangular disc types surrounding V using a depth-first search, 
beginning at the disc type chosen in step 1 above. By "depth-first search", we 
mean that after visiting some triangular disc type, we recursively visit the three 
adjacent 3 triangular disc types in turn (ignoring those that have been visited 
already). 

Each time we visit a triangular disc type, we set the corresponding triangular 
coordinate of x as follows. Suppose we are visiting the triangular disc type 
corresponding to coordinate t^ a , having just come from the (adjacent) triangular 
disc type corresponding to coordinate t; c . Then one of the standard matching 
equations for T is of the form t^ a + q^b = t; c + qjj . Since we already have 
values for tj jC , q^b and q^d , we can use this matching equation to set the unknown 
coordinate t^ a accordingly. 

3. Once this depth-first search is complete, we have values assigned to all triangular 
coordinates of x surrounding V. Let A be the minimum of these triangular 
coordinates; we now subtract X£(V) from x. 

2 We can improve upon 0(n 3 ) by exploiting the sparseness and rationality of the standard 
matching equations; see for instance the ~ 0(n 2 5 ) iterative algorithm of Eberly et al. [8]. 

2 'Adjacent in the sense of the standard matching equations: two adjacent disc types sit within 
adjacent tetrahedra, and their boundary arcs within the common tetrahedron face are parallel. 
Refer to Figure 2 for an illustration. 
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Proof First we note that the algorithm is well-defined; in particular, that each depth- 
first search in step 2 runs to completion (that is, we visit every triangular disc sur- 
rounding V). This follows immediately from the fact that each vertex link £(V) is 
connected. 

Our next task is to prove the algorithm correct. Consider step 1, where we set an 
arbitrary triangular coordinate surrounding vertex V to zero. Suppose instead that we 
set this coordinate to \i. By examining the form of the standard matching equations 
in step 2, we see that this +fi would propagate through every triangular disc type 
suiTounding V; in other words, by the end of step 2 we would have added an extra 
fi£(V) to the solution x. However, this would then cause us to subtract an extra fi£(V) 
from x in step 3. Therefore the value given to the first triangular coordinate in step 1 
does not affect the final solution x. 

Since e(w) is known to satisfy the standard matching equations, and since the only 
coordinate assignment in our algorithm that does not use the standard matching equa- 
tions (step 1) turns out to be irrelevant, it follows that x = e(w). That is, the algorithm 
is correct. 

Finally, we observe that the algorithm runs in 0{n) time. Each of the 3n triangular 
disc types in T is visited precisely once in steps 1 and 2; moreover, for each disc 
type there is a small constant number of adjacencies (three) to examine. It follows 
that, assuming we are careful with our implementation 4 , the time complexity of this 
algorithm is indeed 0(n) . □ 

As a final observation, e must construct a vector of length In by definition, which 
means that any algorithm for computing e(w) must run in at least 0(n) time. Therefore 
the 0(n) time complexity of Algorithm 3. 12 is the fastest time complexity possible. 

4 The Easy Direction: Standard to Quadrilateral 

At this point we are ready to build algorithms for converting between the standard and 
quadrilateral solution sets. In this section we consider the simpler direction: converting 
the standard solution set into the quadrilateral solution set. 

4 For instance, when visiting a disc type in step 2, we do not search through all other disc 
types to find which are adjacent; instead we compute this information directly in constant time. 
Likewise, we do not run through all disc types in T for steps 1 and 3 when we only require 
those surrounding a single vertex V . 
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We begin by proving some necessary and sufficient conditions for vertex normal 
surfaces (Lemmata 4. 1 and 4.3). We then show that the canonical part of every quadri- 
lateral vertex normal surface is also a standard vertex normal surface (Lemma 4.5), 
and use this as the basis for our standard-to-quadrilateral conversion algorithm (Algo- 
rithm 4.6). 

Once again, we assume throughout this section that we are working with a compact 
3 -manifold triangulation T built from n tetrahedra. 

Lemma 4.1 Let S be an embedded normal surface in T for which v(5) 7^ 0. If S 
is a standard vertex normal surface, then whenever \(S) = au + (3w for admissible 
vectors u, w G MJ" and constants a, ft > 0, it must be true that both u and w are 
multiples of \(S). Conversely, if S is not a standard vertex normal surface, then 
there exist embedded normal surfaces U and W and rationals a, j3 > for which 
\(S) = a\(U) + (3\(W) but where neither \(U) nor \(W) are multiples of \(S). 

Moreover, these statements are also true in quadrilateral coordinates, where we replace 
"standard", v(-) and M 7 " with "quadrilateral", q(-) and M 3 " respectively. 

In essence, we are taking a basic fact about polytope vertices and showing that it holds 
true even when we restrict our attention to admissible vectors within the polytope. Note 
that the two statements of this lemma are not exactly converse; instead each is a little 
stronger than the converse of the other, making them slightly easier to exploit later on. 

Proof The proofs are identical in standard and quadrilateral coordinates; here we 
consider standard coordinates only. 

Suppose S is a standard vertex normal surface. Then the given condition on u and w 
follows immediately from the fact that \(S) is a vertex of the polytope 5^(T) . 

On the other hand, suppose that S is not a standard vertex normal surface. Then \(S) is 
not a vertex of the polytope y(T), and so we can find rational vectors u,w G y{T) 
on opposite sides of v(S); that is, u, w / v(S) and \{u + w) = \(S). 

We show that both u and w satisfy the quadrilateral constraints as follows. Without 
loss of generality, suppose that u does not satisfy the quadrilateral constraints. Then, 
since \(S) does, there must be some quadrilateral coordinate qtj that is zero in v(5) 
but strictly positive in u. It follows that this coordinate is negative in w, contradicting 
the claim that w G S^iT) (recall that J^(T) lies in the non-negative orthant). 

Therefore both u and w are rational vectors in =5^(T) that satisfy the quadrilateral 
constraints. It follows from Theorem 2. 10 that we can find embedded normal surfaces 
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U and W for which \(U) = u and \(W) = w, whereupon we find that v(5) = 
a \(U) + (3 v(W) for a, /3 > but neither \(U) nor v(W) is a multiple of v(5). □ 

Note that Lemma 4. 1 has slightly different implications in standard and quadrilateral 
coordinates. For instance, the condition v(S) 7^ requires the surface 5 to be non- 
empty, but q(S) / requires that S is not a union of vertex links. Other differences 
arise regarding scalar multiplication. For example, for certain types of two-sided 
surface S, we have that \(U) is an integer multiple of v(5) if and only if the surface U 
consists of zero or more copies of S. On the other hand, q(U) is an integer multiple of 
q(5) if and only if U consists of zero or more copies of S with possibly some vertex 
links added or subtracted. 

Our next result allows us to identify vertex normal surfaces based purely on which 
coordinates are zero and which are non-zero. 

Definition 4.2 (Domination) Let x and y be vectors in W l . We say that x dominates 
y if, whenever a coordinate xi is zero, the corresponding coordinate yi is zero also. We 
say that x strictly dominates y if (i) x dominates y, and (ii) there is some coordinate 
y, that is zero for which the corresponding coordinate x\ is non-zero. 

For instance, in M? the vector (0, 5, 3) strictly dominates (0, 2, 0), the vectors (1,0, 2) 
and (3,0, 1) both dominate each other (but not strictly), and neither of (0,2,5) or 
(7, 0, 4) dominates the other. 

When discussing domination we use x and x interchangeably, since both x and x have 
zero coordinates in the same positions. 

Lemma 4.3 Let S be an embedded normal surface in T for which v(5) 7^ . If S is a 
standard vertex normal surface, then whenever v(5) dominates u for some admissible 
vector u £ M 7 " , it must be true that u is a multiple of v(5) . Conversely, if S is not a 
standard vertex normal surface, then there is some standard vertex normal surface U 
for which v(5) strictly dominates \(U). 

Moreover, these statements are also true in quadrilateral coordinates, where we replace 
"standard", v(-) and R 7n with "quadrilateral", q(-) and M? n respectively. 

As in Lemma 4. 1 , each half of this lemma is a stronger version of the converse of the 
other. While this makes the statement of the lemma a little less transparent, it also 
makes both halves easier to use in practice (as we will see later in this section). 
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Proof Again the proofs in standard and quadrilateral coordinates are identical; here 
we consider only standard coordinates. 

Suppose that S is a standard vertex normal surface and that v(5) dominates u for some 
admissible u G M 7 " . If u = then u is clearly a multiple of \(S) , so assume that 
Let w = v(5) + e(v(5) — u) for some small e > 0; that is, w is an extension 
of the line joining u and v(5), just beyond v(5). 

Because v(5) and u satisfy the standard matching equations, so does w. Because \(S) 
dominates u, we can keep the coordinates of w non-negative by choosing e sufficiently 
small. Finally, because v(S) satisfies the quadrilateral constraints and u introduces 
no new non-zero coordinates, it follows that w satisfies the quadrilateral constraints 
also. Therefore w is an admissible vector. Since (1 + e)v(S) = w + eu, we have from 
Lemma 4. 1 that u is a multiple of v(5) . 

Now suppose that S is not a standard vertex normal surface. Let F be the minimal- 
dimensional face of the polytope S?(T) containing v(5), and let u be any vertex of F. 
We aim to show that u = \(U) for some standard vertex normal surface U, and that 
v(5) strictly dominates u. 

Consider any coordinate that is zero in v(5) ; without loss of generality let this be qij 
(though it could equally well be a triangular coordinate). The hyperplane qtj = is a 
supporting hyperplane for J^(T) , and since it contains v(5) it must contain the entire 
minimal-dimensional face F. Therefore the coordinate qij is zero at every vertex of 
F, including u. 

Running through all such coordinates, we see that u is dominated by v(5); this 
domination also shows that u satisfies the quadrilateral constraints. Since our polytope 
is rational and u is a vertex it follows that u = \(U) for some standard vertex normal 
surface U. 

Finally, because S is not a standard vertex normal surface we have v(5) ^ u ; the first 
part of this lemma then shows that u cannot dominate v(5) , which means that u must 
be strictly dominated by v(5) . □ 

One simple but useful consequence of Lemma 4.3 is the following. 

Corollary 4.4 Every standard vertex normal surface in T is either (i) canonical, or 
(ii) consists of one or more copies of the link of a single vertex of T. Moreover, the 
link of a single vertex of T is always a standard vertex normal surface. 
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Proof Let 5 be a standard vertex normal surface in T, and suppose that S is not 
canonical. Then S contains at least one vertex linking component; let this be the link 
£(V). It follows that v(S) = £(V) + u for some non-negative u G R ln . Thus v(5) 
dominates £{V) , and from Lemma 4.3 we have that v(5) is a multiple of the vertex link 
£(V). 

Now consider a single vertex link £(V). If this vertex link is not a standard vertex 
normal surface, then from Lemma 4.3 there is some non-empty embedded normal 
surface U for which £(V) strictly dominates \(U). Thus the surface U contains only 
triangular discs surrounding the vertex V, and moreover at least one such triangular 
disc type does not appear in U at all. 

By following the standard matching equations around the vertex V we find that, because 
some triangular coordinate surrounding V is zero in v(i/)> then all such coordinates 
must be zero in \(U). Thus U is the empty surface, giving a contradiction. □ 

We proceed now to the key result that underpins the standard-to-quadrilateral conver- 
sion algorithm. 

Lemma 4.5 The canonical part of every quadrilateral vertex normal surface in T is 
also a standard vertex normal surface in T. 

Proof Let S be a quadrilateral vertex normal surface, and suppose that the canonical 
part n s (S) is not a standard vertex normal surface. Then from Lemma 4.1, there exist 
embedded normal surfaces U and W where \(k s (S)) = a \(U) + j3 \(W) for a, [3 > 
and where neither \(U) nor \(W) is a rational multiple of \(k s (S)). Because k s (S) is 
canonical, it follows from Lemma 3.6 that both U and W are canonical also. 

Using the fact that the quadrilateral projection it is linear and that -k ■ v = q 
(Lemma 3.11), it follows that the analogous relationship q(K s (5')) = a n(U) + (3 q(W) 
must hold in quadrilateral coordinates. Since q • k s = q, this simplifies to q(5) = 
aq(U) + (3q(W). 

Finally, because S is a quadrilateral vertex normal surface, Lemma 4.1 shows that 
both q(U) and q(W) must be rational multiples of q(S) = q(K s (S)). Since the 
canonical extension e preserves scalar multiplication and e-q = v on canonical surfaces 
(Lemma 3.11 again), this implies that both \(U) and \(W) are rational multiples of 
\(k(S)) , a contradiction. □ 

We close this section with our first algorithm for converting between solution sets: 
the conversion from the standard solution set to the quadrilateral solution set. This 
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is the easier direction in all respects — the algorithm is conceptually simple (we use 
Lemma 4.5 to find potential solutions and Lemma 4.3 to verify them), it is simple to 
implement, and it has a guaranteed small polynomial running time 5 (which is unusual 
for vertex enumeration problems). 

Algorithm 4.6 Suppose we are given the standard solution set for the triangulation 
T, and that this standard solution set consists of the k vectors vi , . . . , \t G M 7 " . Then 
the following algorithm computes the quadrilateral solution set for T, and does so in 
0(nk 2 ) time. 

1. Compute the quadrilateral projections 7r(vi), . . . , 7r(v^); recall that this merely 
involves removing the triangular coordinates from each vector. Throw away any 
zero vectors that result, and label the remaining non-zero vectors qi, . . . , q# £ 
M 3 ". 

2. Begin with an empty list of vectors L. For each i = 1, . . . , k' , test whether the 
vector q, dominates any other q ; for i / j . If not, insert the projective image qj 
into the list L. 

3. Once step 2 is complete, the list L holds the complete quadrilateral solution set 
forT. 

Proof Our first task is to prove the algorithm correct. We approach this by (i) showing 
that every member of the quadrilateral solution set does appear in the final list L, and 
then (ii) showing that any other vector does not appear in the final list L. 

• Suppose w E M is a member of the quadrilateral solution set for T . Then w 
is non-zero, and furthermore w = q(S) = q(n s (S)) for some quadrilateral vertex 
normal surface S. From Lemma 4.5, K S (S) is also a standard vertex normal 
surface, and so y(k s (S)) is a member of the standard solution set. Therefore 
\(k s (S)) = \i for some i, whereupon Lemma 3.11 gives us w = q(n s (S)) = 
7] "(v(k 4 (5'))) = 7r(v/). That is, w appears in step 1 as w = q,-/ for some i' . 
Suppose now that w does not appear in the final list L. This can only be because 
q,/ dominates qy for some / / i' . From step 1 we know that qj> = 7r(y/) for 
some vector \j ^ v, in the standard solution set. Moreover, neither v, nor V/ 
is a multiple of a vertex link (otherwise q,v or q ; / would be zero); therefore 
Corollary 4.4 shows that both V; and \j are canonical, and so v,- = e(q,' ) and 
Yj = e(q 7 ). 

5 Of course this must be polynomial in not just n but also the size of the input, i.e., the 
standard solution set. There are families of triangulations for which the standard solution set is 
known to have size exponential in «; see [6] for some examples. 
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Because q,v dominates q,v, it follows from Lemma 4.3 that qji is a multiple of 
q,-/. Since e preserves scalar multiplication, v,- = e(q ( ') is also a multiple of 
Xj = e(q/). Finally, since v, and \j both belong to the standard solution set, 
their coordinates must both sum to one and we obtain v, = Vj , a contradiction. 

• Suppose now that w G M 3 " is not a member of the quadrilateral solution set for 
T . From Lemma 4.3 there is some quadrilateral vertex normal surface U for 
which w strictly dominates q(U), and from the previous argument the projective 
image q(U) appears in step 1 as some qj/ . This domination ensures that w is 
tossed away in step 2, and so does not appear in the final list L. 

We see then that L contains precisely the quadrilateral solution set for T as claimed. 
Note that step 2 ensures that L contains no duplicate vectors (i.e., that L is a "true 
set"); otherwise each would dominate the other. We finish by observing that all 
vector operations take 0(n) time and that steps 1 and 2 require 0(k) and 0(k 2 ) vector 
operations respectively, giving a running time of 0(nk 2 ) in total. □ 

5 The Hard Direction: Quadrilateral to Standard 

We come now to our second conversion algorithm for solution sets: the conversion 
from the quadrilateral solution set to the standard solution set. Although this is the 
more difficult conversion, with a messy implementation and a worst-case exponential 
running time, it is ultimately the more useful. In particular: 

• It gives us genuinely new surfaces, which Lemma 4.5 shows is not true in the 
reverse direction. This means that we can potentially learn new information 
about the underlying triangulation and 3 -manifold. 

• It forms the basis for a new enumeration algorithm to generate the standard 
solution set, which runs orders of magnitude faster than the current state-of-the- 
art. 

We begin with some prerequisite tools in Section 5.1, where we introduce some ad- 
ditional vector maps and then discuss polyhedral cones and their interaction with the 
quadrilateral constraints. Following this, Section 5.2 is devoted to presenting and prov- 
ing the quadrilateral-to-standard solution set conversion algorithm (Algorithm 5.15). 
We finish in Section 5.3 with a brief discussion of time complexity (Conjecture 5.16) 
and the new enumeration algorithm described above (Algorithm 5.17). As discussed 
back in the introduction, this final enumeration algorithm is the real "end product" 
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of this paper, and we devote all of Section 6 to testing its performance in a practical 
setting. 

As before, we assume throughout this section that we are working with a compact 
3 -manifold triangulation T built from n tetrahedra. 

5.1 Vector Maps and Polyhedral Cones 

To present and prove the quadrilateral-to-standard conversion algorithm (Algorithm 5.15), 
we need to call upon two new families of vector maps, both of which involve the vertices 
of the triangulation T. 

Definition 5.1 (Partial Canonical Part) Let the vertices of T be labelled V\ , . . . , V m , 
and let w be any vector in R 7 ". For each i = 1, . . . ,m, the ith partial canonical part 
of w is denoted /4 (w) and is defined as follows. Let A G R be the largest scalar 
for which all of the coordinates of w — X£(Vi) that correspond to triangular disc types 
surrounding V,- are non-negative. Then we define rc®(w) = w - \£(Vd. 

Essentially (w) is a "restricted" canonical part of w where we only allow copies of 
the vertex link l(V{) to be added or subtracted. It is simple to see that applying this 
procedure to all vertices gives the usual canonical part k v , that is, k v = k[P o . . . o . 
Like k v , the partial maps re£ are not linear but do preserve scalar multiplication. 

Definition 5.2 (Truncation) Let the vertices of T be labelled V\ , . . . , V m , and let 
w be any vector in R 7 ". For each i = 0, . . . ,m, the ith truncation of w is denoted 
t ; (w) , and is defined as follows. We first locate all coordinates in w that correspond 
to triangular disc types surrounding the vertices Vf+i, . . . ,V m . Then t,(w) is obtained 
from w by setting each of these coordinates to zero. 

For convenience, if S C R 7 " is any set of vectors then we let r,(S) denote the corre- 
sponding set of ith truncations; that is, T;(S) = {r,(w) | w G S}. 

The 0th truncation To(w) is most severe, setting all triangular coordinates in w to zero. 
At the other extreme, the mth truncation has no effect whatsoever, with r m (w) = w. 
Each truncation map is linear, and it is clear that r, o tj = r m j n (jj) . Note that truncation 
does not preserve admissibility, since r,(w) might not satisfy the standard matching 
equations even if w does. 

In general it is impossible to undo truncations precisely. However, for admissible 
vectors the errors are controllable, as seen in the following result. 
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Lemma 5.3 Consider any two admissible vectors x, y G WL. If t;_i(x) = r,„i(y), 
then Tj(x) = T,(y) + fi£(Vj) for some /i£R. 

Proof Because r/_i does not affect any quadrilateral coordinates, we have 7r(x) = 
7r(y). With Lemma 3.11 we can convert this into k v (x) = K v (y), whereupon the result 
is a simple consequence of Definition 3.9. □ 

For the remainder of this section we focus on polyhedral cones. These are used heavily 
in the proof of Algorithm 5.15, and we concentrate in particular on their interaction 
with the quadrilateral constraints. 

Definition 5.4 (Polyhedral Cone) A polyhedral cone in M. d is an intersection of 
finitely many closed half-spaces in W l , all of whose bounding hyperplanes pass through 
the origin. 

A pointed polyhedral cone in ¥l d is a polyhedral cone in ¥L d for which the origin is 
an extreme point. Equivalently, it is a polyhedral cone in W l that has a supporting 
hyperplane meeting it only at the origin. 

It is clear that every polyhedral cone C is convex and closed under non-negative scalar 
multiplication (that is, x, y G C implies Ax + fiy G C for all A, /i > 0). An example 
of a polyhedral cone that is not pointed is the infinite prism {x G M 3 \xi,X2 > 0}, 
for which any supporting hyperplane containing must also contain the entire line 

X\ = X2 = 0. 



Figure 5: A pointed polyhedral cone with five basis vectors 

Definition 5.5 (Basis) Let S be any set of vectors in W 1 . By a basis for S, we mean 
a subset of vectors B C S for which 
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(i) every vector of S can be expressed as a non-negative linear combination of 
vectors in B ; 

(ii) if any vector is removed from B then property (i) no longer holds. 

It is straightforward to see that we can replace (ii) with the equivalent property 

(ii') no vector in B can be expressed as a non-negative linear combination of the 
others. 

Although our definition of a basis is designed with polyhedral cones in mind, it is 
deliberately broad; this is because we will need to apply it not only to polyhedral cones 
but also to non-convex sets, such as the semi-admissible parts to be defined shortly. 
Note that for general sets S, property (i) does not work in reverse — there might well 
be non-negative linear combinations of vectors in B that are not elements of the set 5. 

For a pointed polyhedral cone C, the vectors in a basis correspond to the edges of the 
cone; these edges are also known as extremal rays of C. Figure 5 illustrates a pointed 
polyhedral cone C with a supporting hyperplane H as described by Definition 5.4; 
the five points marked in black together form a basis for C. The basis for a pointed 
polyhedral cone is essentially unique and can be used to reconstruct the cone, as noted 
by the following well known results. 

Lemma 5.6 Every polyhedral cone C has a finite basis. Moreover, if B and B' are 
both bases for a pointed polyhedral cone C, then there is a one-to-one correspondence 
between B and B' that takes each vector to a positive scalar multiple of itself. 

Lemma 5.7 Let B C M d be a finite set of vectors for which 

(i) no element of B can be expressed as a non-negative linear combination of the 
others; 

(ii) there is some hyperplane H C M. d passing through for which every vector 
of B lies strictly to the same side of H (in particular, none of these vectors lie 
within H ). 

Then the set of all non-negative linear combinations of vectors in B forms a pointed 
polyhedral cone with B as its basis. 

Some pairs of basis vectors are adjacent, in the sense that the corresponding edges of 
the cone are joined by two-dimensional faces. 6 In Figure 5 above, adjacent pairs of 
basis vectors are marked by dotted lines. We define adjacency formally as follows. 

6 Note that the only one-dimensional faces of a polyhedral cone are its extremal rays, i.e., 
rays of the form {Ab | A > 0} where b is a basis vector. 
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Definition 5.8 (Adjacency) Let b and b' be two distinct basis vectors for a pointed 
polyhedral cone C. We define b and b' to be adjacent if the smallest-dimensional face 
of C containing both b and b' has dimension two. 

Bases of polyhedral cones provide a very limited form of uniqueness when taking 
non-negative linear combinations, as seen in the following simple lemma. 

Lemma 5.9 Let B = {b\ , . . . , b^} be a basis for a pointed polyhedral cone C C W 1 . 
If some b, G B can be written as a non-negative linear combination of basis vectors 
(that is, b r = Ajbj where all A, > 0), then this linear combination must be the trivial 
b r = b r . That is, \ r = 1 and A,- = for i / r . 

Proof Suppose we have some non-negative linear combination b, = ^A,b,. If 
A,- < 1 then we obtain b,- as a non-negative linear combination of the other basis 
vectors b, (i / r), in violation of Definition 5.5. Therefore A,- > 1, and we can 
subtract b,- to obtain as a non-negative linear combination = 2^ Ajb,- . 

Since our cone is pointed, it has a supporting hyperplane H for which G H but every 
b, lies strictly to one side of H. The only way to obtain this with non-negative A- is to 
set every Aj = 0, showing our original linear combination to be the trivial b r = b, . □ 

The uniqueness in Lemma 5.9 is limited in the sense that it only holds when b r is 
a basis vector. In general, an arbitrary point x G C might well be expressible as a 
non-negative linear combination of basis vectors in several different ways. Even for 
basis elements, it should be noted that Lemma 5.9 can fail for non-pointed cones. 

An even weaker form of uniqueness exists for combinations of adjacent basis vectors, 
and indeed can be used to completely characterise adjacency as follows. 

Lemma 5.10 Let B = {bi, . . . , b^} be a basis for a pointed polyhedral cone C cM. d . 
Two distinct basis vectors b r , b s G B are adjacent if and only if, whenever f^ib,- + i]b s = 
2^ Ajb; for /i, 7], A, > 0, we must have A; = for every i / r,s. 

In other words, b,- and b s are adjacent if and only if any non-negative linear combination 
of basis vectors b,- and b s can only be expressed as a non-negative linear combination 
of basis vectors b,- and b^ . 

Proof To prove this we use two equivalent characterisations of faces for polyhedral 
cones 7 , both of which are described by Br0ndsted [2]: 

'Although these characterisations are equivalent for polytopes and polyhedra, they are not 
equivalent for general convex sets. 
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(a) A set F C C is a face of C if and only if F = C, F = 0, or F = C n H for 
some supporting hyperplane //; 

(b) A set F C C is a face of C if and only if (i) F is convex, and (ii) whenever 
the open line segment (x, y) contains a point in F for some x, y £ C, the entire 
closed line segment [x, y] lies in F. 

We also note that every face of a polyhedral cone (and thus every supporting hyperplane 
above) must pass through the origin. 

Suppose the basis vectors b r and b v are adjacent, and that fib r + rjb s = ^ A,b, for 
some fi,r],Xi > 0. Let F be the smallest-dimensional face of C containing both b, 
and b s ; since F is two-dimensional, it cannot contain any other basis vector b, for 
i / r,s. 

Using (a) above, we can write F = C n H for some supporting hyperplane H passing 
through the origin. We see that b, and b s lie in H and every other basis vector lies 
strictly to one side of H, whereupon our non-negative linear combination must have 
A; = for every i ^r,s. 

Suppose now that the basis vectors b r and b s are not adjacent. Let G be the two- 
dimensional plane passing through b r , b v and the origin; the non-adjacency of b r and 
b s shows that G cannot be a face of C. Therefore, by (b) above, there are points 
x, y G C for which (x, y) meets G but [x, y] ^ G. 

Let z £ (x, y) n G. Because z G G we can write z = fjb r + rjb s for some /i, r] > 0. 
On the other hand, we can also write z as a non-trivial convex combination of x and 
y. Since [x, y] ^ G at least one of x and y cannot be expressed purely in terms of b,- 
and b v , and we obtain z = fjb r + r]b s = Ajb, where every A; > and some A,- > 
for i / r,s. □ 

There are other characterisations of adjacency, such as the algebraic and combinatorial 
conditions described by Fukuda and Prodon [9]. However, Lemma 5.10 will be more 
useful to us when we come to the proof of Algorithm 5.15. 

The double description method, devised by Motzkin et al. [19] and improved upon 
by other authors since, is a standard algorithm for inductively converting a set of 
half-spaces that define a polyhedral cone into a basis for this same cone. The double 
description method plays an important role in the standard enumeration of normal 
surfaces; the reader is referred to [5] for both theoretical and practical details. Although 
we do not explicitly call upon the double description method here, we do rely on one 
of its core components, which is the following result. 
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Lemma 5.11 Let C C W 1 be a pointed polyhedral cone with basis B, and let H be 
a half-space defined by the linear inequality H = {x G R d \ x ■ h > 0} . Then the 
intersection C D H is also a pointed polyhedral cone, and we can compute a basis for 
C n H as follows. 



Partition the basis B into sets S = {b G B | b • h = 0} , S + = {b G B \ b • h > 0} and 
S_ = {b G B | b • h < 0} . Then a basis forCHH is 




Figure 6: Intersecting a pointed polyhedral cone with a new half-space 

This procedure is illustrated in Figure 6. For further details on the double description 
method (including Lemma 5.11), the reader is referred to the excellent overview by 
Fukuda and Prodon [9]. 

When we come to proving Algorithm 5.15, we will need to work with restricted 
portions of polyhedral cones that satisfy the quadrilateral constraints. This motivates 
the following definition. 

Definition 5.12 (Semi- Admissible Part) Consider any set of vectors S C M 7 " . The 
semi-admissible part of 5, denoted a(S), is the subset of all vectors in S that satisfy 
the quadrilateral constraints. 

We call this the sera/-admissible part because we deliberately make no mention of 
non-negativity or the matching equations. This is essential — in Algorithm 5.15 we 
deal with vectors that satisfy the quadrilateral constraints but that can have negative 
coordinates, and in the corresponding proof we take ith truncations of these vectors 
which can break the matching equations. 
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It is important to note that the semi-admissible part of a polyhedral cone C may well 
be non-convex, and so might not be a polyhedral cone in itself. Nevertheless, a(C) 
remains closed under non-negative scalar multiplication. 

The following result shows that, for "sufficiently non-negative" pointed polyhedral 
cones C, bases for C and bases for a(C) are tightly related. 

Lemma 5.13 Let C be a pointed polyhedral cone in W" where, for every x G C, 
the quadrilateral coordinates of x are all non-negative. If B is a basis for C, then the 
semi-admissible part a(B) forms a basis for a(C) . Conversely, every basis for a(C) 
can be expressed in the form a(B) where B is a basis for C . 

Proof Suppose that B = {bi , . . . , b^} is a basis for C. 

• Since B is a basis it is clear that every x G a(C) C C can be expressed as 
x = A,bj with all A, > 0. Furthermore, if A,- > for any b, that does not 
satisfy the quadrilateral constraints, the non-negativity condition on C ensures 
that x = A;b,- + . . . cannot satisfy the quadrilateral constraints either. Thus 
x = J2 ^ib; i s actually a non-negative linear combination of vectors in a(B) . 

• Since no element of B can be expressed as a non-negative linear combination of 
the others, the same must be true of a(B) C B. 

It follows by Definition 5.5 that a(B) is a basis for a(C). 

Conversely, let B' be a basis for a(C), and let B = {bi , . . . , b*} be some basis for C. 
For each b, G a(B) , we modify B as follows. 

• Since B' is a basis for a(C) , we can express b; as a non-negative linear combi- 
nation of elements of B' ; we mark this linear combination (★) for later reference. 
Because B is a basis for C, we can expand (*) to a non-negative linear combi- 
nation of elements of B. Thus we obtain b, = Yl ^fij for A 7 > 0. 
However, Lemma 5.9 shows that the only such linear combination can be b; = 
b,. Since all linear combinations are non-negative, it follows that the first 
linear combination (*) must likewise consist only of positive multiples of b, ; in 
particular, we must have fibi G B' for some /x > 0. We now replace b, with 
/ib, in B ; it is clear that B remains a basis for C. 

By following this procedure for each b; G a(B), we obtain a basis B for C that 
satisfies B' 5 a{B) . However, from the first part of this lemma a(B) is also a basis 
for a(C). Therefore any additional vectors in B' would be redundant, and so we have 
B' = a(B). □ 
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We conclude our brief study of polyhedral cones with an example of a semi-admissible 
part and its basis that we have seen before. The following observations are all immediate 
consequences of the relevant definitions and Lemma 5.13. 

Example 5.14 Let C C R 7 " be the set of all vectors whose entries are all non-negative 
and which satisfy the standard matching equations for the triangulation T . Then C 
is a pointed polyhedral cone, the standard projective solution space y(T) is a finite 
cross-section of this cone (taken along the projective hyperplane J 7 " ), and the vertices 
of the polytope y(T) form a basis for C . Furthermore, a(C) = R 7 " (the set of all 
admissible vectors in R 7 " ), and the standard solution set forms a basis for a(C) . 

5.2 The Main Conversion Algorithm 

We are now ready to present the quadrilateral-to-standard solution set conversion al- 
gorithm in full detail. The algorithm relies on the numbering of standard coordinate 
positions — here we number coordinate positions 1,2, ...,7n according to Defini- 
tion 2.4, so that positions li + {1,2, 3,4} correspond to triangular coordinates and 
positions li + {5, 6, 0} correspond to quadrilateral coordinates. For an arbitrary vector 
w G R 7 " , we use the common notation whereby vv; G R denotes the coordinate of w 
in the ith position. 

Roughly speaking, the algorithm operates as follows. Given the m vertices V\ , . . . , V m 
of the triangulation, we inductively build lists of vectors Lo,Li, . . . ,L m . Each list 
L r generates all admissible vectors that can be formed by (i) combining vectors 
from the quadrilateral solution space and then (ii) adding or subtracting vertex links 
£(V\), . . . ,£(V r ). In particular, the initial list Lq is the quadrilateral solution set, and 
(after appropriate scaling) the final list L m becomes the standard solution set. 

Each inductive step that transforms L r into L r+ \ is based on the double description 
method, though complications arise because we do not have access to the full facet 
structures of the underlying polyhedral cones. As we construct each list L r we essen- 
tially ignore all triangular coordinates around the subsequent vertices V r +i, ■ ■ ■ , V m , 
though we do maintain the standard matching equations at all times. This selective 
ignorance is expressed in the proof through the truncation function r r , and is resolved 
in the algorithm itself by taking the partial canonical part k v when the need arises. 

Algorithm 5.15 Suppose we are given the quadrilateral solution set for the triangu- 
lation T, and that this quadrilateral solution set consists of the k vectors qi, . . . , q* G 
R 3 " . Then the following algorithm computes the standard solution set for T . 
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Letthe vertices ofT beV\, . . . , V m . We construct lists of vectors Lq,L\,..., L m C M 7 " 
as follows. 8 

1. Fill the list Lq with the canonical extensions e(q\) , . . . , e(qt) G M 7 ", using 
Algorithm 3. 12 to perform the computations. 

2. Create a set of coordinate positions C C {1,2,..., In} and initialise this to the 
set of all quadrilateral coordinate positions, so that 

C = {5,6,7, 12,13,14, 7n-2,7n- l,7n}. 

This set will grow as the algorithm runs, eventually expanding to all of {1,2, ... , In} . 

3. For each r = 1,2, ... ,m, till the list L r as follows. 

(a) For each vector x G L r _i, insert the partial canonical part k\, (x) into L r . 

(b) Insert the negative vertex link —£(V r ) into L r . 

(c) Let T r C {1 , 2, . . . j In} be the set of all coordinate positions corresponding 
to triangular disc types in the vertex link £(V r ); that is, T r = {p | £(V r ) p / 
0}. For each position p G T r , perform the following steps. 

(i) Partition the list L r into three lists So, S + and 5_ according to the 
sign of the p th coordinate. Specifically, let So = {x G L r \ x p = 0} , 
S + = {x G L r | x p > 0} and S_ = {x G L r \ x p < 0} . 

(ii) Create a new temporary list L' = So U S + . 

(Hi) Run through all pairs of vectors u G 5 + and w G 5_ that satisfy both 
of the following conditions: 

- u and w together satisfy the quadrilateral constraints. That is, for 
each tetrahedron A/ ofT,at least two of the three quadrilateral 
coordinates for A, are zero in both u and w simultaneously. 

- There is no vector z G L r other than u and w for which, whenever 
a coordinate position i G C satisfies both = and w\ = 0, 
then Zi = aiso. 

For each such pair, insert the vector (u p w — w p u) / (u p — w p ) into the 
temporary list L' . Note that this vector is the point where the line 
joining u and w meets the hyperplane {x G M 7 " \x p = 0} . 
(iv) Empty out the list L r and refill it with the vectors in L' , and insert the 
coordinate position p into the set C. 

8 We use set notation with these lists because, as we see in the proof, they contain no duplicate 
vectors. We call them lists here because the implementation can happily treat them as such; in 
particular, there is no need to explicitly check for duplicates when we insert vectors into lists 
as the algorithm progresses. 
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(d) Finish the list by inserting the positive vertex link £(V r ) into L r . 

Suppose that the very last list L m consists of the k' vectors Vi, . . . , v# € K 7 " ■ Then 
the standard solution set for T consists of the k' projective images vT, . . . , v# . 

Before we embark on a proof that this algorithm is correct, there are a few points worth 
noting. 

• Unlike the previous algorithms in this paper, the statement of Algorithm 5.15 
does not include a time complexity. This is because the algorithm can grow 
exponentially slow with respect to the size of the input. 

For examples of this exponential growth the reader is referred to [6], which 
describes the solution sets for the n-tetrahedron twisted layered loop, a highly 
symmetric triangulation of the quotient space 5 /Qah- In these examples the 
quadrilateral solution set has size ©(«), whereas the standard solution set has 
size 9(0") for = (1 + y/5)/2. Thus the size of the output is exponential in 
the size of the input, and so the running time of any conversion algorithm must 
be at least this bad. 9 

On the other hand, it is possible — and indeed quite plausible — that the running 
time of Algorithm 5.15 is polynomial in the size of the output. For further 
discussion, see Conjecture 5.16 later in this section. 

• Step 3(c) bears a resemblance to the double description method of Motzkin 
et al. [19]. As discussed earlier, this is no accident — in a sense, within each 
iteration of step 3 we create a new pointed polyhedral cone and then enumerate 
its admissible extreme rays. The differences appear in the processing of pairs 
u G 5+ and w G 5_, where we deviate from the usual double description 
method in the constraints on u and w. 

• As presented, Algorithm 5.15 requires exact arithmetic on rational numbers, 
which may be undesirable in practice for reasons of performance or implemen- 
tation. We can avoid this by observing that throughout steps 1-3 we can replace 
any vector x with any multiple Ax (A > 0) without changing the final solution 
set. This means that we can work entirely within the integers by rescaling vectors 
appropriately. 

Proof of Algorithm 5.15 This is a lengthy proof, consisting of two nested inductions 
corresponding to the two nested loops of steps 3 and 3(c). We therefore split this proof 

'Here we use the standard notation for complexity whereby O(-) indicates an asymptotic 
upper bound and O(-) indicates an asymptotically tight bound. 
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into six parts: I— III to establish the outer induction, and IV- VI to establish the inner 
induction. The road map for parts I— III is given below. Because the inner induction 
sits within part II, we delay the road map for parts IV- VI until then. 

Our outer induction proves a statement about the finished lists Lq, . . . , L m . In order to 
make this statement, we define the space srf r for each r = 0, . . . , m to be 



That is, £? r consists of all non-negative vectors in M. that can be expressed as (i) a non- 
negative linear combination of the original k vectors from the quadrilateral solution 
space, plus (ii) arbitrary positive or negative multiples of the first r vertex links. 10 Our 
key inductive claim relates the space srf r to the list L r as follows: 

Claim: Once the list L r is fully constructed, it consists only of admissible 
vectors. Furthermore, the truncation r,(L,-) is a basis for the semi-admissible 
part a(T,-(£^ r )). (*) 

Our outer induction now proceeds according to the following plan. 

Road map for parts I— III: 

I. Show that (*) is true for r = 0; 

II. Show that if (*) is true for r = i — 1 where i > then (*) is also true 



III. Show that if (*) is true for r = m then Algorithm 5.15 is correct. 
Because part II is significantly more complex than the others (in particular, it contains 
the inner induction), we shall subvert the natural order of things and deal with parts I 
and III first. 



We begin with part I, where we must prove (*) for r = 0. Note that gfo can be written 
more simply as 



10 It can be shown that each srf r is a pointed polyhedral cone, though we do not need this fact 
here. 
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Furthermore, because each e(q,) is admissible the constraints x p > are redundant, 
and so s^q is merely the set of all non-negative linear combinations of e(qi), . . . , £{<\k)- 
Because truncation is linear, ro(^>) is likewise the set of all non-negative linear com- 
binations of ro(e(qi)), . . . , To(e(qk)). Noting that neither To nor e affects quadrilateral 
coordinates, we can make the following observations: 

• Suppose that some ro(e(q,)) G M 7 " could be expressed as a linear combination 
of the others. Restricting our attention to quadrilateral coordinates 11 would 
therefore give some q, G M 3 " as a linear combination of the others, in violation 
of Lemma 4. 1 . 

• Since the vectors ro(e(q;)) are all non-zero vectors with non-negative coordi- 
nates, they all lie to the same side of the hyperplane Y2 x p = 0- 

It follows from Lemma 5.7 that tq(s^q) is a pointed polyhedral cone with tq{Lq) 
as its basis. Moreover, since each q, satisfies the quadrilateral constraints we have 
a(ro(Lo)) = ro(Lo), and so by Lemma 5.13 tq(Lq) is a basis for a(ro(i^)) also. 
Finally, it is clear from construction that every vector in Lq is admissible. 

— Part IH — 

We now jump straight to part III, where we can ignore truncations entirely because r m 
is the identity map. We assume therefore that L m is a basis for a(£/ m ), and our task 
is to prove from this that the projective images of the vectors in L m together form the 
standard solution set for T. 

The key observation here is that the semi-admissible part a(£/ m ) is simply R 7 ", the set 
of all admissible vectors in standard coordinates. To see this: 

• Every vector in a(£/,„) has non-negative coordinates by definition of £/ m , and 
satisfies the quadrilateral constraints by definition of a . Moreover, since every 
e(q ; ) and l(Vj) satisfies the standard matching equations, so does every vector 
in a(£4). Thus a(srf m ) C R 7 ". 

• Let x G M 7 ". By Definition 2.11, the quadrilateral projection ir(x) can be 
expressed as a non-negative combination of vertices of the quadrilateral pro- 
jective solution space J2(T). More specifically, tt(x) can be expressed as a 
non-negative combination of admissible vertices of J2(T) , since otherwise tt(x) 
would not satisfy the quadrilateral constraints. Therefore 7r(x) = A ; q; for 
some A,- > 0. 

"More precisely, applying the linear map it. Note that 7T o to o e = i, the identity map. 
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By chasing maps around the commutative diagram in Lemma 3.1 1 and recalling 
that 7r is linear and e preserves scalar multiplication, we subsequently derive 
the equation k v (x) = k v (Y^ A,e(q,)) ■ That is, x is a non-negative linear com- 
bination of e(q ; ) plus some arbitrary linear combination of vertex links. Hence 

x G a(£/ m ), and we have MJ a n C a{s^ m ). 

From here part III is straightforward. We know that L m is a basis for MJj 1 = a(srf m ), 
and from Example 5.14 we know that the standard solution set is a basis for W a n also. 
Expressing MJ a " as the semi-admissible part of a pointed polyhedral cone (Example 5.14 
again), we can combine Lemmata 5.6 and 5.13 to show that the basis for a{s/ m ) is 
unique up to scalar multiplication. It follows that once we take projective images, the 
list L m and the standard solution set are identical. 



— Part II — 



All that remains is part II, the inductive step. Suppose we are constructing the list L r 
for some r > 0. Our outer inductive hypothesis is that the list L r _i consists only of 
admissible vectors and that r r _i(L r _i) is a basis for a(T r -i(^/ r ~i)) ■ Our task is to 
prove that, once the list L,- is complete, it too consists only of admissible vectors with 
the truncation T r (L r ) forming a basis for a(r r (£/,-)) . 



To show this, we must dig into the construction of the list L r and perform a new inner 
induction over the constructive loop in step 3(c) of the algorithm. Suppose the list L,-_i 
consists of the vectors ai , . . . , a,. For every set of coordinate positions P, we define a 
new space 



(2) 



x = ^A4 r) (a I )-jM?<y r ) 



A; > V/ G i..t, 

lh >0, 

x p > V/? G P 



Essentially, S$f> is constructed by taking non-negative linear combinations of (i) the 
rth partial canonical parts of vectors in L r _i , and (ii) the negative vertex link —£(V r ). 
Note that we relax our insistence on non-negative coordinates — vectors in may 
include negative coordinates, as long as these only occur at coordinate positions outside 
the set P. 

Our inner inductive claim is the following. It should be read as a loop invariant that 
applies before and after each position p G T r is processed in step 3(c) of Algorithm 5.15. 
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Claim: Every vector x in the partially-constructed list L r satisfies both the 
standard matching equations and the quadrilateral constraints, and has at 
least one coordinate position p G T r for which x p < 0. Furthermore, the 
truncation T r (&c) is a pointed polyhedral cone, and the truncation T r (L r ) 
forms a basis for the semi-admissible part a(T r ({$c))- (t) 

Note that both the list L r and the set C continue to change as step 3(c) iterates through 
each position p G T,-. Our claim is that they both change together in a way that 
maintains the truth of (f). 

The remainder of this proof proceeds according to the following plan. Once again, the 
context for this plan is that we are currently constructing the list L r in the rth iteration 
of step 3 of the algorithm. 

Road map for parts IV- VI: 

IV. Show that (f) is true when we first reach step 3(c); 

V. Show that, when processing some p G T r in step 3(c), if (f) is true be- 
fore running step 3(c)(i) then ( f ) is still true after running step 3(c)(iv); 

VI. Show that, if (f ) is true after the loop in step 3(c) finishes, then (*) is 
true at the end of step 3(d). 
In other words, parts IV and V constitute an inner induction to establish the correctness 
of the invariant ( f ) throughout the construction of the list L r . Part VI then uses this 
invariant to prove the outer inductive claim (*), concluding part II and the proof of 
Algorithm 5.15. 

Throughout parts IV-VI we continue to assume the outer inductive hypothesis; that 
is, that L r _i consists of the admissible vectors ai,...,a ; , and that the truncation 

t,.„i(L,._i) forms a basis for q(t,-_i( ! k^_i)). 

— Part IV — 

We begin our inner induction with part IV, at the point where we first reach step 3(c). 
At this point in the algorithm, the relevant variables take the following values: 

• L r consists of k\! (ai), . . . , «v (fy) an d the negative vertex link — £(V r ); 

• C consists of all quadrilateral coordinate positions, as well as the triangular 
coordinate positions in sets T\ , . . . , 7V_ i . 

Our task is to show that the claim (f ) holds true for these values of L r and C. 

It is clear from construction that every x G L r has at least one coordinate position 
p G T, for which x p < 0. Moreover, since the outer inductive hypothesis shows that 
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every a, is admissible, we can see that (i) every x 6 L r satisfies both the standard 
matching equations and the quadrilateral constraints, and that (ii) the only coordinates 
in any x G L r that might be negative are those in positions p G T r . Noting that 
T r n C = , the constraint x p > \/p 6 C in equation (2) is therefore redundant in this 
case, and we simply have 

(3) ^ c = J x = ^ A/K^CaO - /^(V,) 

I i=l 

It remains to show that T r [B§c) is a pointed polyhedral cone, and that T r (L r ) forms a 
basis for a(r, (^c))- 



Aj > V/ G l..f, 
Mr>0 



From (3) it is clear that SSq is the set of all non-negative linear combinations of vectors 
in L r , and thus T r {S3c) is the set of all non-negative linear combinations of vectors in 
T r (L r ). We now focus on establishing the conditions of Lemma 5.7 for the list r r (L r ). 

(i) Suppose that some vector in T r (L r ) can be written as a non-negative linear 
combination of the other vectors in r r (L r ). Taking the linear map r r -\ and 
recalling that r r _i o r r = 7>_i, it follows that the corresponding vector in 
t>_ i (L r ) can be written as the same non-negative linear combination of the other 
vectors in r, ._ i (L r ) . 

For each re(f (a/) G L r we have r r _i(Ki , (a,-)) = r r _i(a,), and for — G L r 
we have r r _i(— £(V r )) = 0. Thus r r _i(L r ) consists of the basis r r _i(L r _i) 
combined with the zero vector, and so the only possible non-negative linear 
combination in r r _i(L r ) is the trivial combination 7>_i(— £(V r )) = 0. It follows 
that our original non-negative linear combination in r r (L r ) must have been 
7>(— i(V r )) = 0, a contradiction. 

(ii) We aim now to construct a hyperplane H C M 7 " for which every vector in r r (L r ) 
lies strictly to the same side of H. To do this, we define the temporary vector 
u = 7>_i(l). That is, u contains 1 in all quadrilateral coordinate positions 
as well as the triangle positions p G T\ U . . . U T r -\, and contains in the 
remaining triangle positions p G T r U . . . U T m . Recall also that the vertex link 
£(V r ) contains 1 in all triangle positions p G T r , and contains in all other 
triangle and quadrilateral positions. 

Define the constants 

g = mm {u • r r (4 r) (a,))} and h = max{^(y r ) ■ r r (4 r) (a/))} . 
Since 7>_i(L r _i) is a basis of non-negative vectors and u • r r (Ky (^i)) = u ' 

(V) 

7>_i(a;), it is clear that g > 0. Furthermore, from the definition of k\, and the 
fact that £(V r ) ■ r r (Kv r) (a,)) = £(V r ) ■ 4 r) (a ; ) it is clear that h > 0. 
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Let H be the hyperplane {x G R 7 " | (h + l)u • x = g£(V r ) • x}. We show now 
that every element of T r {L r ) lies strictly to the same side of H. By definition of 
g and h, if x = T r (K v (a;)) G T r (L r ) then we have (h + l)u • x > (h + l)g > 
gh > g£(V r ) • x. Finally, if x = t>(— £(V r )) G r r (L r ) then this simplifies to 
x = — £(V r ) , and so l)u • x = > g£(y r ) • x. Therefore H is the hyperplane 
that we require. 

It follows from Lemma 5.7 that T r {S3c) is a pointed polyhedral cone with r r (L r ) as 
its basis. Finally, since every a, is admissible it is clear that every vector of r r (L r ) 
satisfies the quadrilateral constraints; thus a(r r (L r )) = r r (L r ), and Lemma 5.13 shows 
that 7>(L r ) is a basis for a(r r (^c)) also. 

— Part V — 

We come now to part V, the main inductive step for the inner induction. Here we 
assume that (f) holds before running step 3(c)(i); our task is to show that (f) still holds 
after running step 3(c)(iv). 

Throughout this part, we assume that we are building the list L r , and that we are 
currently processing some coordinate position p G T r . We use the following notation: 

• L r and C denote the initial states of these variables, before step 3(c)(i). 

• Sq , S+ and are as defined in Algorithm 5. 15; that is, Sq = {x G L r \ x p = 0} , 
S + = {x G L r | Xp > 0} and S- = {x G L r \ x p < 0} . 

• L' denotes the final state of the list after step 3(c)(iv). In other words, 



(4) L' = S US + U 



UpW — w p u 



w„ 



u G S + and w G 5_ , 

u, w together satisfy the quad, constraints, 
$z G £,-\{u, w} for which 

(/'GCU {p} and u t = Wj = 0) Zi = 

In addition, we note that the final state of the set C is simply CU {p} . We can therefore 
assume claim (f) exactly as written, and our task is to prove the following: 

(a) Every x G L' satisfies both the standard matching equations and the quadrilateral 
constraints, and has at least one coordinate position p' G T, for which x p > < ; 

(b) The truncation T r (^cu{p}) i s a pointed polyhedral cone; 

(c) The truncation r r (L') forms a basis for a(T, (^cu{p}))- 

Claim (a) is straightforward; these properties are already known to be true for all vectors 
in Sq, S+ , S_ C L r , and it is clear by construction that they also hold for vectors new to 
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L' . In particular, x p = for each new vector x = (u p w — w p u) / (u p — w p ) . Claim (b) 
is also straightforward, since equation (2) shows that 7>(^cu{p}) * s the intersection of 
the pointed polyhedral cone T r (0c) with the half-space x p > 0. We therefore focus 
our efforts on proving (c), that is, that t,-(L') forms a basis for a(r r (^cu{p}))- 

We know from ( f ) that L r forms a basis for a{r r {3Sc)) . where r r {,S%c) is a pointed 
polyhedral cone. From Lemma 5.13, there is a basis M for 7>(<^c) f° r which L r = 
a(M). As noted earlier, the final polyhedral cone 7>(<S^cu{p}) is simply T r (3§c) 
intersected with the half-space x p > ; our plan is to use this fact to convert M into a 
basis for r,-(^ cu{p}) an d then a basis for a(T,.(--^aj{p}))> which we will see is simply 
the final list L' . 

To convert M into a basis for T r (^aj{p})> we ca U upon the regular double description 
method. Just as M is a superset of L r , we define the supersets Mq = {m G M \ m p = 
0} 5 So, M + = {m£M m p > 0} 5 5+ and M_={mel| m p < 0} 5 5_. 
Lemma 5.11 then shows that the following is a basis for T r (^ cu ^ p y) = r r (^c) H 
{x|jc p >0}: 



, I M„W — WnU 

M = Mq U M + U ' p 



u G M + and w G M_ , 
u, w are adjacent basis vectors in r r (3§c) 



w p 

Using Lemma 5.13 and the observation that u p > > w p , a corresponding basis for 
the semi-admissible part a(T r (^cu{p})) i s 

u G S_l and w G 5_ 



a(M') = S U 5+ U 



u, w together satisfy the quad, constraints, 
u, w are adjacent basis vectors in r r (^c) 



Consider the following claim, which we will prove shortly. 

Claim: Suppose u and w are basis vectors for T r (£$c) that together satisfy 
the quadrilateral constraints. Then u and w are adjacent if and only if there 
is no z G M\{u, w} for which, whenever i G C and Ui = Wj = 0, we must 
have Zi = 0. ($) 

If this is true, then our basis for ct(T r (3§c\Jip})) can b e rewritten as 

u G S+ and w G S_ , 



a(M') = S U 5+ U 



u p w — w p u 



u, w together satisfy the quad, constraints, 
$z G M\{u, w} for which 

(i G C and w, = w ; - = 0) =^ z, = 

Because C contains all quadrilateral positions, we can change z G M\{u, w} in the 
final condition above to z G L,\{u,w}. Furthermore, because u p ,w p / we can 



Algebraic & Geometric Topology XX(20XX) 



Converting Between Quadrilateral and Standard Solution Sets 



1043 



change i G C in this same condition to i G C U {/?} . The equation then becomes 
identical to (4), and we see that our basis a(M') is indeed the final list L' . 

The only thing now remaining for part V is to prove the claim (ss). We do this using 
Lemma 5. 10. 

Suppose that u and w are not adjacent basis vectors in r r {0c). By Lemma 5.10 there is 
some x G t>(^c) and some coefficients /x, rj, Xj > for which x = fiu+?]W = Yl ^y^!/> 
where each by is a basis vector for r,-(^c) an d where Ay > for some by 7^ u, w. 
Because the /th coordinate of every basis vector is non-negative for every i G C, it 
follows that whenever = w; = for i £ C we must have (by); = also. Therefore 
by satisfies the conditions for z as specified in (^). 

Suppose now that u and w are adjacent basis vectors in -ry^c) that together satisfy the 
quadrilateral constraints, and that z is some different basis vector for which, whenever 
i G C and U[ = w ; - = 0, we have zt = also. We show that this leads to a contradiction. 

Let x = u+£w where £ > is chosen so that x p < 0, and let y = x— ez for some small 
e > 0. If y G T r {,$%c) then we can express y = ^ A;b,, where each A; > and each 
b, is a basis vector for T r (,3%c) ■ This gives us x = u + £w = ez + ^ A,b; , whereupon 
Lemma 5.10 shows that u and w cannot be adjacent, giving us the contradiction that 
we seek. 

It remains to prove that y G t,-(3§c) ■ The condition on z ensures that for sufficiently 
small e > we have y,- > for all i G C, so all we need to show is that y can be 
expressed as a linear combination y = J2 i A ; K(, r) (a;) — fi r £(V r ) for A;, fi r > 0. 

From (2) all vectors in satisfy the standard matching equations. Since y is a linear 
combination of vectors in r r (^c)> it follows that y = r,-(y') for some y' G M. 1 " that 
also satisfies the standard matching equations. Because y ; - > for all i G C we see 
that both y and y' satisfy the quadrilateral constraints, and that y' + YlT=r C'^W) i s a 
non-negative vector for some coefficients £ r , . . . , Cm G K. Therefore y' + Y^7=r C'^W) 
is admissible. 

It follows that 7r(y' + Yti= r CAVi)) = 7r(y0 G M 3 " can be expressed as a non- 
negative linear combination of vectors in the quadrilateral solution set, and so from 
equation (1) we see that r r _!(y' + Y!i=rCd(Vi)) = 7>-l(y0 G r r _i(^_i). Using 
the quadrilateral constraints for y' we then obtain r r _i(y') G a(r r _i(=e/ r _i)), and so 
r r -i(y') = E/=i A,r,._i(a,) for some Ai, . . . , X t > 0. 

Because y' is admissible, Lemma 5.3 shows that the only error we can introduce 
by replacing r r _i with t> is a multiple of the vertex link £(V r ). Therefore y = 
r r (y') = Yl'i=i ^i T r(&i) + /^(K) for some coefficient /x G M. Since the partial 
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canonical part only adds or subtracts multiples of £(V r ), we can rewrite this as 
y = E/=i A ; -4 r) (Tr(a ; -)) + n'£(Yr). Finally, because we chose x and y to satisfy 
yp < x p < we must have y! < 0, and equation (2) shows that y G t,.(3§c) as 
required. 



Moving to the final part VI, we now assume that (f) holds at the end of step 3(c) of the 
algorithm; our task then is to prove that (*) holds at the end of step 3(d). 

At this stage of the algorithm, the set C contains all positions p G T r (amongst others). 
Consider any x G 3§c- We know that x can be expressed as a non-negative vector 
minus fi,-£(V r ), but we also know that x p > for all p G C 5 T r . It follows that every 
x G 3!c is a non-negative vector, and so in this case we can write £%c as 



That is, we can replace the specific condition x p > Mp G C with the more general 
condition x p > Vp G 1 . .In . 

We pick off the easy part of (*) first. From (f) we know that after step 3(c) every 
x G L r satisfies both the standard matching equations and the quadrilateral constraints, 
and from (5) every x G L r is a non-negative vector also. Thus L r consists only of 
admissible vectors, and inserting the vertex link in step 3(d) does not change this fact. 

It remains to prove that r r (L r ) forms a basis for a(r r (£/ r )) . We do this directly through 
Definition 5.5. 

(i) At the end of step 3(c) of the algorithm, we know from (f) that r r (L r ) forms 
a basis for a(r r (^c))- It follows that r r {L r ) C a(r r (^c))> an d that every 
x G a(T r (3§c)) can b e expressed as a non-negative linear combination of vectors 
in T r (L r ). We aim to show the same for every x G a(r r (j^)) at the end of 
step 3(d). 

It can be seen from the definition of srf r that 

srf r = {x = a + p,£(y r ) | a G stf r -\ and x p > \/p G 1..7«}, and hence 
a(7>(<c/ r )) = {x = a + fd(y r ) | a G a(r r (^_i)) and x p > Vp G I.. In}. 

We now call upon the outer inductive hypothesis; in particular, the fact that 
T r -\(L r -\) is a basis for a(r r _i(«e^-_i)). Combining this with Lemma 5.3 to 
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replace T r _i with r r , our equation becomes 



a(7>04)) = a N x = A,r,.(a/) + /i£(V r ) 



A ; - > OVi G l..f, 
x P > OVp G 1..7n 




Finally, using equation (5) and the fact that k\, only ever adds or subtracts 
copies of £(V r ), we obtain 

a(T r (£f r )) = {b + fU(y r ) I b G a(T r (^ c )) and /i > 0}. 

That is, a(jr(&/r)) consists of all non-negative linear combinations of (a) vectors 
in a.{r r (3Bcj), and (b) the vertex link £(V r ). It follows from (f) that, once 
we insert the vertex link into L r in step 3(d) of the algorithm, we know that 
T r (L r ) C a{T r {s/ r )) and that every x G a(T r (£f r )) can be expressed as a non- 
negative linear combination of vectors in r r {L r ) . 

(ii) We now show that, after step 3(d) of the algorithm, no vector in T r (L r ) can be 
expressed as a non-negative linear combination of the others. Let L' r be the list 
L r as it was immediately after step 3(c) (that is, without the vertex link); from (f ) 
we know this property is true for T r {L' r ) . Denote the vectors in L' r as bi , . . . , h q . 
Suppose that some vector in r, (L r ) can be expressed as a non-negative linear 
combination of the others. Because the list r ; -(L r ) contains only the basis 
elements 7>(bi), . . . , T r (b q ) and the vertex link l{V r ), our expression must be of 
one of the following two types: 

• r r (b,) = Yjm ^j T r(bj) + (i>£(Vr) for Ay > and n > 0. That is, the vertex 
link £(V r ) appears as a non-empty part of this linear combination. 



Because b,- is a non-negative vector, the clause x p < in (f) implies that 
K v (bj) = b{. However, because every by is also a non-negative vector, the 
presence of the vertex link on the right hand side above implies that 



That is, K v (bi) / b,-, giving us a contradiction. 
. £(y r ) = Ey A i r r(by) for Ay > 0. That is, the vertex link £(V r ) can be 
expressed as a non-negative linear combination of truncated vectors in L' r . 

Since all by are non-negative, every by that features in this linear combi- 
nation must have all its quadrilateral coordinates equal to zero. Each such 
by is also admissible, whereupon Lemma 3.11 can be used to show it is a 
non-negative combination of vertex links. More precisely, non-negativity 
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again shows that each corresponding r r (b y ) must be a multiple of the single 
vertex link £(V r ). However, this yields the expression r r (b,) = fi£(V r ), 
which we have shown above to be impossible. 

This concludes the requirements for Definition 5.5, whereupon we see that r, (L,) must 
form a basis for a(r r (^/ r )) . Indeed, this also concludes part VI, and therefore the entire 
proof of Algorithm 5.15. □ 



5.3 Time Complexity and the Enumeration Algorithm 

We now return to the issue of time complexity, which was raised briefly following 
the statement of the quadrilateral-to-standard solution set conversion algorithm (Al- 
gorithm 5.15). It has already been noted that this conversion algorithm can grow 
exponentially slow in the size of the input; it is also seen in [5] that the enumera- 
tion algorithms for the standard and quadrilateral solution space suffer from the same 
problem. 

We have already discussed examples where the size of the standard solution space is 
exponential in n (punishing the enumeration algorithm) and also exponential in the size 
of the quadrilateral solution space (punishing the conversion algorithm). However, this 
is not our worst problem. The intermediate lists that are created by these algorithms 
can potentially grow exponentially large with respect to both the input and the output, 
leading to situations where both the standard and quadrilateral solution space are very 
small, yet the enumeration algorithms take a very long time to run. 

The root of the problem lies in the double description method, upon which the enu- 
meration algorithms are built. Using Lemma 5.11, the double description method 
inductively builds a series of lists, the last of which becomes the standard or quadri- 
lateral solution space. It is well known that the double description method can suffer 
from a combinatorial explosion, where the intermediate lists can grow exponentially 
large before shrinking back down to what might be a very small output set. See [1,9] 
for discussions of how this combinatorial explosion can be tamed in general, and [5] 
for techniques specific to normal surface enumeration. 

Because the quadrilateral-to-standard conversion algorithm incorporates aspects of the 
double description method, one should expect it to suffer from the same problems. 
However, empirical evidence suggests that it does not — in Section 6 we find that the 
intermediate lists in Algorithm 5.15 appear not to explode in size (never growing larger 
than lJf times the output size), and that the total running time for conversion appears 
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to be negligible in comparison to enumeration. In light of these observations, we put 
forward the following proposal. 

Conjecture 5.16 The time complexity of Algorithm 5.15 is at worst polynomial in 
the size of the output. That is, the running time is at most a polynomial function of n 
(the number of tetrahedra) and k' (the size of the standard solution set). 

More specifically, it seems reasonable to believe based on experimental evidence 
that the intermediate lists for Algorithm 5.15 are at worst linear in k! , from which 
Conjecture 5.16 would follow as an immediate consequence. A possible cause could 
be the highly structured ways in which the intermediate polyhedral cones si r and S3q 
are formed in the proof of Algorithm 5.15. 

We finish this section with the new enumeration algorithm that was promised in the in- 
troduction and again at the beginning of Section 5. Specifically, we use Algorithm 5.15 
as a key component in a new algorithm for enumerating the standard solution space. As 
discussed in the introduction, the enumeration problem has great practical significance 
in normal surface theory but suffers from the feasibility problems of an exponential 
running time. In this context, the new algorithm below is a significant improvement — 
we find in Section 6 that for large cases it runs thousands and even millions of times 
faster than the current state-of-the-art. 

This current state-of-the-art is described in [5] ; essentially we begin with the double 
description method of Motzkin et al. [19], apply the filtering techniques of Letscher, 
and then incorporate a range of further improvements that exploit special properties of 
the normal surface enumeration problem. We refer to this modified double description 
method as direct enumeration. 

Our new enumeration algorithm combines direct enumeration with Algorithm 5.15, 
and runs as follows. 

Algorithm 5.17 To compute the standard solution set for the triangulation T, we can 
use the following algorithm. 

1. Use direct enumeration to compute the quadrilateral solution set for T. 

2. Use Algorithm 5.15 to convert this quadrilateral solution set into the standard 
solution set for T . 

We expect this algorithm to perform well — although the direct enumeration in quadri- 
lateral coordinates (step 1) remains exponentially slow, in practice it runs many orders 
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of magnitude faster than a direct enumeration in standard coordinates [5]. Following 
this, the quadrilateral-to-standard conversion (step 2) is found to run extremely quickly, 
as discussed above. 

All that remains is to test these claims in practice, which brings us to the final section 
of this paper. 

6 Measuring Performance 

To conclude this paper we measure the performance of our new algorithms through a 
series of practical tests. These tests involve running both old and new algorithms over 
500 different triangulations, taking a variety of measurements along the way. 

The triangulations chosen for these tests are the first 500 orientable triangulations from 
the Hodgson-Weeks closed hyperbolic census [13]; their sizes range from 9 to 25 
tetrahedra. All computations were performed on a single 2.3 GHz AMD Opteron pro- 
cessor using the software package Regina [3,4]. There are alternative implementations 
of normal surface enumeration available, notably the FXrays software by Culler and 
Dunfield [7]; we use Regina here because, with the improvements of [5], it is found 
in the author's experience to have the greater efficiency in both time and memory for 
large triangulations. 12 

Our fust tests compare running times for the new enumeration algorithm in standard 
coordinates (Algorithm 5.17) against the old state-of-the-art (the modified double 
description method of [5], referred to earlier as "direct enumeration"). The following 
observations can be made: 

• Figure 7 plots new running times directly against old running times, with one 
point for each of the 500 triangulations. Both axes use a log scale, since running 
times for both algorithms are spread out across several orders of magnitude. The 
diagonal lines are guides to illustrate the magnitude of the improvements. 
It is immediately clear that the new algorithm is faster, and significantly so. 
The weakest improvement is still over 10 times the speed, and the strongest 
is over 2000000 times. Roughly speaking, the largest cases experience the 
greatest improvements (which is what we hope for). Some additional points 
worth noting: 

12 This observation concerns direct enumeration (prior to this paper). As seen in the following 
graphs, the new algorithms developed in this paper are significantly more efficient again. 
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Figure 7: Comparing the old direct enumeration against the new Algorithm 5.17 



- The resolution of the timer is 0.01 seconds. This explains the long horizon- 
tal clumps in the bottom-left coiner of the graph — here the new algorithm 
runs in literally the smallest times that can be measured. An error factor 
of 0.005 seconds has been added to all measurements to compensate for 
cases where the time is measured to be zero. 

- Whilst the new algorithm ran to completion for all 500 triangulations, the 
old algorithm did not. Eight cases were terminated after 30 days of running 
time; these are the eight points at the rightmost end of the plot. This early 
termination underestimates the improvements due to the new algorithm; 
the real improvements might well be orders of magnitude larger again. 

• In Figure 8 we plot the improvement factor (the old running time divided by the 
new running time) against both the input size and the output size (the size of the 
quadrilateral and standard solution sets respectively). 

One striking observation is how small the solution sets are, given that the tri- 
angulations range from n = 9 to n = 25 tetrahedra and that the sizes of the 
solution sets can grow exponentially in n. We examine this effect in greater 
detail in [6]. 

If we focus on cases with unusually large input and output sets — those points 
that escape the dense clouds at the left of each plot — we find again that the 
improvements are particularly strong. Amongst the triangulations with input 
size > 100 the improvement factors range from over 4000 to over 2000000. 
Likewise, with the exception of just one triangulation, those with output size 
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Improvements vs input size 



Improvements vs output size 
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Figure 8: Speed improvement factors for the new Algorithm 5.17 



> 500 have improvements ranging from over 2 000 to over 2 000 000. The lone 
exception has output size 1 141 and an improvement factor of 37. 

Our final tests examine the feasibility of Conjecture 5.16. Recall that this conjecture 
states that the running time for the quadrilateral-to-standard solution set conversion 
algorithm (Algorithm 5.15) is at worst polynomial in the size of the output. For this to 
occur we must avoid the combinatorial explosion in the sizes of the intermediate lists 
^Oj^i j • • • j L m . 

Figure 9 measures the extent of this combinatorial explosion. Specifically, for each 
triangulation we measure the size of the maximal list divided by the size of the final 
list — if we have a combinatorial explosion we expect this ratio to be very large, and 
if not then we expect it to remain close to one. We then bin these measurements into 
small ranges and plot the resulting frequencies in a histogram (so in each of the three 
plots, the sum of the heights of the bars is always 500). We take these measurements 
not only for Algorithm 5.15 but also for the old direct enumeration algorithm in both 
quadrilateral and standard coordinates. 

What we see is exactly what we hope for. With the old direct enumeration algorithms, 
the maximal list can grow to hundreds of times the output size (and perhaps larger, 
recalling that for the eight worst cases the direct enumeration in standard coordinates 
was prematurely terminated after 30 days). For Algorithm 5.15 this ratio is never 
greater than \ . That is, the behaviour we see is consistent with the intermediate lists 
being bounded by a linear function of the output size. 

Figure 10 tests our conjecture more directly by plotting the running time of Algo- 
rithm 5.15 against the output size kf (the size of the standard solution set). Once again, 
both axes use a log scale so that the data points are more evenly distributed. 
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Figure 10: The running time for Algorithm 5. 15 as a function of output size 



It is reasonable to ignore all points where the running time is under 0.1 seconds, 
since the clock resolution is only 0.01 seconds (once again we see horizontal bands of 
points where the running times are the smallest that can be measured). Not only does 
the clock resolution introduce large relative errors for these points, but they are also 
highly susceptible to what would otherwise be negligible tasks, such as initialising data 
structures at the beginning of the algorithm, or extracting algebraic information from 
the triangulation. 

Focusing our attention therefore on the points with time > 0.1 s (or equivalently, with 
output size > 500), we find that the points follow what appears to be a straight line. If 
t is the running time, this corresponds to an equation of the form log t = a logfc' + /?, 
or equivalently, t oc k' a . That is, the time does indeed appear polynomial in the output 
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size k' . 

We can measure the degree of this polynomial by performing a linear regression. This 
regression is indicated by the dashed line in Figure 10; its equation is approximately 

log? = 2.4729 x log k' - 18.5016. 

That is, the running time appears to be a little under t oc &' 2 5 . The adjusted correlation 
coefficient for this regression is r ~ 0.96, indicating an extremely good linear fit. 

Note that t oc k' 2 - 5 is quite reasonable, given the structure of Algorithm 5.15. If we 
assume that each list L, has size 0{k'), then each inductive step L, — > L,+i involves 
at least 0{k' 2 ) iterations through the innermost loop (running through all u G S + and 
w G This inner loop can in turn take 0(k') time as it tests for adjacency by 

searching for an appropriate z £ L r ; however, Fukuda and Prodon [9] note that such 
searches often terminate early, and our additional test on the quadrilateral constraints 
means that many such searches can be avoided entirely. We therefore expect an average 
running time of between 0(k' 2 ) and 0(k' 3 ), which is precisely what we see. 

One might observe that we have neglected the number of tetrahedra n entirely in this 
empirical discussion of Conjecture 5.16. Of course n features implicitly in the size of 
the output, since each vector in the standard solution set has dimension In . We focus 
on k! here because it spans several orders of magnitude, ranging from 17 to 16 106; in 
contrast, n merely ranges from 9 to 25. Since the size of the standard solution set can 
grow exponentially in n (and this is also found to be true in the average case [6]), it is 
reasonable to expect k' to become the dominating factor in the running time. 



Appendix: Notation 



Throughout this paper we introduce a number of symbols that are used in the statements 
and proofs of results. For convenience, the following tables list the key symbols and 
where they are defined. 
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Sets and Vector Spaces: 



Symbol 


Meaning 


Point of definition 


Qd 


Non-negative orthant 


Definition 2.11 


J d 


Projective hyperplane 






Standard projective solution space 




&<X) 


Quadrilateral projective solution space 




8 


All embedded normal surfaces 


Notation 3.7 


s c 


All canonical embedded normal surfaces 




Rl", Rl" 


Admissible vectors in R ln or R 3n 




Zl", 7% 


Admissible integer vectors in Z 7w or Z 3n 




Tain njln 
K a,c> ^a,c 


Admissible canonical vectors in R ln or Z 7 " 






Used for loop invariants in Algorithm 5.15 


Equations (1) and (2) 



Maps: 



Symbol 


Meaning 


Point of definition 


*(•) 


Vertex link (surface or vector) 


Definition 2.3 


v(0, q(0 


Vector representation 


Definition 2.4 


~ v(-), q(-) 


Projective image 


Definition 2.12 


O"v(0, <?q(-) 


Represented surface 


Definition 3.8 


Ks(-), K v (-) 


Canonical part (surface or vector) 


Definition 3.9 


tt(-) 


Quadrilateral projection 


Definition 3.10 


£(•) 


Canonical extension 


Definition 3.10 


4\) 


Partial canonical part 


Definition 5.1 


Ti(-) 


Truncation 


Definition 5.2 


«(0 


Semi-admissible part 


Definition 5.12 
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